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s  and  diagnosis? 

Along  with  the  feature  extraction  problem,  given  an 
electrical  network  of  known  topology,  what  are  the  conditions 
for  testability? 

To  attack  the  long  standing  fault  isolation  problem  in 
analog  electronic  circuits,  we  have  focused  on  two  of  the 
major  problems.  One  is  the  presence' of  uncertainties  such 
as  indeterminacy,  vagueness,  randomness,  and  so  on  that 
naturally  arise  during  the  solution  procedure  of  analog 
fault  isolation.  The  other  is  the  presence  of  topological^  rest¬ 
rictions  inherent  in  specific  circuit  configurations.  ^ 

Our  main  attention  was  focused  on  dealing  with  the  fault 
|  isolation  problem  involving  various  kinds  of  uncertainties  such 
as  indeterminacy  or  vagueness.  We  show  that  such  problems  lend 
themselves  very  well  to  and  in  fact  can  be  solved  by  adopting 
fuzzy  set  concepts.  In  particular  this  line  of  research  has 
produced  a  modified  fuzzy  set  technique  applicable  to  automatic 
fault  isolation.  Topological  aspects  utilizing  graph  theory  may 
be  used  effectively  to  assist  in  preanalysis  of  faulty  analog 
electronic  circuits.  As  a  spin  off  of  a  consideration  of  these 
problems,  we  developed  some  new  theorems  for  element  value 
solvability.  It  should  be  made  clear  however  that  effective 
fault  isolation  can  be  accomplished  with  or  without  this  pre¬ 
analysis  to  assist  in  resolving  the  more  fundamental  problem 
incurred  by  uncertainty. 

As  a  consequence,  this  research  yields  the  following 
specific  results: 

1.  A  base  line  automatic  isolation  system  which  can  be 
used  to  deal  with  various  kinds  of  uncertainties.  A  fuzzy  auto¬ 
mation  model  served  as  a  point  of  departure  for  the  base  line 
system.  Various  fuzzy  relations  are  used  to  select  and  update 
the  parameters  and  structures  of  system. 

2.  Set  of  algorithms  and  new  decision  criteria  which  can 
be  implemented  easily  and  used  for  effective  fault  isolation.  A 
fuzzy  distance  measure  and  a  fuzzy  entropy  measure  are  used  for 
decision  making  in  the  fault  isolation  algorithms.  The  results 
are  shown  to  be  generally  more  effective  than  existing  techniques 

3.  Ample  illustrative  examples  and  simulation  studies  are 
included  to  back  up  these  new  methods.  Several  examples  such 
as  low  pass  filter,  band  pass  filter,  and  communcation  I/O  cir¬ 
cuits  are  used  to  illustrate  the  simulation  studies.  The  results 
of  simulation  studies  demonstrate  the  applicability  of  a  fuzzy 
set  technique. 
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XII 


GLOSSARY  OF  TERMS 


A.  Definitions 


Analog  Circuit:  Electronic  subsystem,  component,  or  printed 
circuit  board. 

Analog  System:  Set  of  analog  circuits  (boards)  processing 
analog  signals. 

Fault ;  Physical  defect  causing  a  failure. 

Failure:  Effect  of  fault. 

Fault  Feature  Extraction:  Process  that  simplifies  the  fault 
isolation  problem  sufficiently  to  render  it  tracable  for  the 


fault  feature  selection. 


Selection  of  effective  fault 


features  from  a  given  set  of  feature  measurements. 

Fault  Diagnosis:  Determination  of  the  cause  of  a  fault 
(e.g.,  the  exact  value  of  off-tolerance  parameters). 

Test  points:  Connections  or  nodes  of  a  circuit  to  which  it 
is  possible  to  connect  a  measuring  equipment. 

Test  program:  Definition  of  the  test  procedure. 

Testability :  Capability  to  find  out  if  the  unit  under  test 
is  operational  or  not  as  well  as  the  ability  to  find  out 
which  component  or  group  of  components  have  failed. 

Stimuli:  Signals  applied  to  the  system's  inputs. 


B.  Faults 


xiii 


Deviation  Fault:  The  value  of  a  parameter  deviates  in  a 
continuous  manner  with  time  or  with  environmental  conditions 
up  to  an  unacceptable  value. 

Catastrophic  Faults:  Those  faults  caused  by  a  sudden  and 
large  variation  of  a  parameter  (e.g.,  short,  open, 

break-down) . 

Single  Faults;  Those  faults  concerning  only  one  parameter 
or  a  component  at  a  time. 

Multiple  Faults:  Those  fault  concerning  simultaneously 
several  parameters  or  components. 

C.  Types  of  Tests 

Functional  Test:  Verification  of  the  function  of  modules 
for  nominal  characteristics  and  conditions. 

Parametric  Test:  Verification  of  analog  characteristics 
within  specified  tolerance  {voltages,  currents,  impedances, 

load  conditions,  etc.). 

Static  Test:  Verification  of  stable  states  of  unit  under 

test. 

Dynamic  Test:  Verification  of  dynamic  characteristics  of 
the  unit  under  test,  for  normal  use  conditions  (in 
particular  for  transient  analysis) . 

Exhaustive  Test:  Verification  of  all  modes  of  operation  for 
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all  types  of  faults. 

Partial  Test:  Verification  is  limited  to  certain 

characteristics  or  to  a  limited  number  of  faults. 

Off-line  Test:  Test  of  which  operation  of  the  system  under 
test  is  interrupted. 

On-line  Test:  Test  of  which  operation  of  the  system  under 
test  is  not  interrupted. 
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CHAPTER  1  Introduction  and  Summary 

1.1  Motivation 

The  development  of  automatic  test  generation  (ATG)  for 
analog  systems  (AS)  lags  far  behind  that  for  digital  systems 
partly  because  even  under  ideal  conditions  the  complex 
interaction  of  the  many  components  affects  the  response 
signals.  Herein  we  confine  our  attention  to  analog 
electronic  systems  even  though  the  general  approach  is  not 
necessarily  that  limited.  Due  to  the  imprecision  and 
indeterminacy  of  the  complex  structure  of  faulty  networks , 
it  is  usually  difficult  to  obtain  exact  solutions.  It 
should  be  stressed  that  for  fault  isolation  it  is 
unnecessary  to  seek  the  exact  solutions.  Nevertheless,  in 
the  realistic  situations  component  '’rifts  and  measurement 
noise  must  somehow  also  be  taken  into  consideration.  We  can 
for  convenience  interpret  such  a  system  as  a  fuzzy  system  so 
that  the  fuzzy  set  concept  of  Zadeh  becomes  the  basis  for  a 
fault  isolation  method. 

It  is  well  known  that  the  topology  of  an  electrical 
network  with  only  a  limited  number  of  accessible  terminals 
limits  the  testability  of  the  unit  under  test  (UUT) . 
Testability  refers  to  the  capability  to  find  out  if  the  UUT 
is  operational  or  not  as  well  as  the  ability  to  find  out 
which  component  or  group  of  components  have  failed.  To 
accomplish  this  effect,  access  to  suitable  test  terminals  is 


necessary.  Berkowitz  (74)  introduced  the  concept  of  element 
value  solvability  as  necessary  conditions  for  solving  the 
values  of  lumped  network  elements  given  limited  access. 
Using  graph  theoretical  aspects  of  this  element  value 
solvability,  we  can  determine  the  sufficiency  of  the  access 
terminals,  or  the  solvability  of  the  network. 

1.2  Statement  of  the  Problem 

There  are  essentially  three  •  fundamental  problems 
involved  in  achieving  effective  automatic  generation  of 
fault  isolation  tests  for  analog  electronic  systems  : 
feature  extraction,  fault  classification  and  diagnosis. 

For  practical  electronic  circuits  having  component 
drifts  and  measurement  noise,  how  are  we  able  to  introduce 
fuzzy  set  concepts  and  provide  methods  to  achieve  fault 
classification  and  diagnosis? 

Along  with  the  feature  extraction  problem,  given  an 
electrical  network  of  known  topology,  what  are  the 
conditions  for  testability? 

1.3  Scope 

For  practical  analog  electronic  circuits  having 
component  drifts  and  measurement  noise,  we  adopt  a  fuzzy 
system  model  of  faulty  analog  electronic  circuits. 
Considering  fuzzy  system  models  of  faulty  analog  circuits, 
the  following  specific  objectives  are  sought:  (1)  To  develop 
criteria  for  fault  diagnosis  and  to  optimize  the  level  of 
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diagnosability  via  learning  algorithms  in  order  to  reduce 
the  computational  effort.  (2)  To  develop  efficient 
computational  algorithm  for  assessing  the  power  of 
discrimination  in  the  test  signals  among  fault  conditions 
via  information  theoretical  point  of  view.  (3)  To  verify 
and  assess  the  efficiency  of  the  proposed  test  method  by 
carrying  out  computer  simulations  on  typical  circuits.  This 
approach  lends  itself  to  treatment  of  integrated  circuits. 

Introduction  to  the  state  of  the  art  in  network  element 
value  solvability  and  effort  toward  it3  solution  are  to  be 
found  in  papers  by  Berkowitz  (74)  ,  Bedrosian  (78) ,  Gayer 
(11) ,and  Navid  and  Willson  (14).  In  this  dissertation  we 
extend  their  work  by  providing  a  method  to  determine  the 
necessary  and  sufficient  conditions  for  the  solvability  of 
the  network  for  single  and  two-element-kind  networks.  This 
includes  an  algorithm  to  determine  the  network  solvability 
and  the  necessary  theorems. 

*  ' 

1.4  Summary 

In  Chapter  2  the  state  of  the  art  is  reviewed.  A 
summary  of  Zadeh's  fuzzy  set  theory  is  introduced.  Some 
clarification  is  given  of  its  suitability  and  relationship 
to  faulty  analog  circuits. 

In  Chapter  3  a  fuzzy  automaton  model  (FAM)  is 
formulated  as  a  basis  for  a  fault  isolation  method.  Various 
properties  of  three  fuzzy  relations  in  fuzzy  automata  are 
examined.  Especially  learning  properties  of  fuzzy  automata 
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are  studied  and  applied  to  analog  fault  isolation  problem. 
Section  3.5  deals  with  the  problem  of  selecting  the  best  set 


of  parameters  for  fault  tests  using  the  fuzzy  automaton 
model.  An  example  of  this  learning  technique  is  applied  to 
simulated  faults  on  a  simple  active  circuit.  Section  3.6 
deals  with  the  application  of  fuzzy  relations  to  the  highly 
overlapped  fault  patterns.  Fault  pattern  classes  are  first 

/  anri  f\y7rr\i  nart*R  corresDondina  to 
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non-overlapping  and  overlapping  regions  obtained  by 
sensitivity  analysis.  The  grade  of  membership  of  the  fuzzy 
parts  are  then  modified  according  to  simulation  results  and 


the  decision  based  on  fuzzy  relations. 

In  Chapter  4  two  classes  of  information  measures  are 
defined  as  measures  of  information  content  in  the  fuzzy 
system,  namely  fuzzy  distance  measure  (FDM)  and  fuzzy 
entropy  measure  (FEM) .  Their  properties  are  discussed  and 
their  applications  to  fault  diagnosis  with  FAM  have  been 
made.  Section  4.4  utilizes  a  special  form  of  Tellegen's 
theorem  to  get  the  necessary  values  of  port  currents  and 
voltages  for  diagnostic  purposes.  A  fault  isolation 
algorithm  using  fuzzy  distance  measure  is  developed.  A 
simulation  of  part  of  a  communication  I/O  circuit  is  used  as 
an  example.  Section  4.5  discusses  a  fuzzy  measure  to 
facilitate  analog  fault  diagnosis  having  nonlinearity, 
component  drift  and  noise.  The  algorithm  presented  herein 
makes  use  o£  the  available  measured  data  on  port  responses 


to  isolate  the  faulty  component  based  on  fuzzy  set  concepts. 

Chapter  5  includes  a  summary  and  conclusions  for  the 
present  study  followed  by  some  suggestions  for  futher  work. 

In  Appendices  necessary  and  sufficient  conditions  for 
solvability  of  single  and  two  element  kind  network  are 
given.  An  algorithm  to  determine  the  network  solvability 
is  developed.  Detailed  examples  are  included.  Summary  of 
NAP 2  Nonlinear  Analysis  Program  is  introduced. 
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CHAPTER  2  Analog  System  Failure  in  the  Context  of  Fuzzy 
Sets 

2.1  Introduction 

In  view  of  the  declining  availability  of  skilled 
manpower,  it  becomes  important  to  develop  and  adopt 
systematic  means  for  analyzing  faulty  analog  electronic 
systems.  The  development  of  fault  isolation  techniques  for 
analog  systems  lags  behind  that  for  digital  systems  partly 
because  the  complex  interaction  of  many  components  affects 
the  response  signals.  Practical  analog  systems  are  exposed 
to  noisy  environments.  Under  fault  conditions  such  systems 

i 

in  general  become  nonlinear.  The  behavior  of  faulty  systems 
can  conveniently  be  considered  in  the  context  of  fuzzy 
systems  (12,35,37). 

Fuzzy  system  denotes  a  system  with  vague  inputs,  vague 
states,  and  vague  outputs  for  a  given  system  structure 
interacting  with  the  fuzzy  environment.  We  call  those 
variables  such  as  vague  inputs,  vague  outputs,  and  vague 
states  as  "informal"  variables  (43). 

The  rationale  for  the  development  of  fuzzy  system  can  be 
described  as  follows.  Informal  variables  suffer  from 
vagueness  or  indeterminacy,  so  that  a  deterministic  system 
is  hopelessly  inadequate  to  represent  them.  The  traditional 
response  c^n  be  interpreted  to  mean  that  the  informal 
variables  must  be  constrained  ,  so  that  the  deterministic 
system  will  apply.  The  fuzzy  system  approach  proposes. 
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instead,  to  loosen  up,  or  "fuzzify"  the  deterministic  system 
to  obtain  a  new  system  which  is  directly  applicable  to 
constrained  informal  variables. 

Fuzzy  set  theory  itself  has  been  developed  since  1965 
(35).  The  theory  has  been  applied  to  the  various  fields 
such  as  pattern  recognition,  formal  languages,  medical 
diagnosis,  automata  theory,  and  so  on.  The  primary  part  of 
this  study  focuses  or.  formulation  and  solution  of  some  of 
the  specific  real  problems  in  the  area  of  analog  fault 
analysis  by  applying  fuzzy  set  theory  in  conjunction  with 
other  related  theories.  For  convenience  the  subjects  of  the 
study  are  grouped  into  three  parts:  1)  Analog  system  failure 
in  the  context  of  fuzzy  set  theory,  2)  A  fuzzy  automaton 
model  and  its  application  to  fault  analysis,  3)  Fuzzy 
measures  and  their  applications  to  fault  analysis. 

Since  some  of  the  pattern  recognition  aspects  play 
major  roles  in  the  area  of  fault  analysis,  fuzzy  measures, 
such  as  fuzzy  entropy  and  fuzzy  distance,  are  defined. 
Above  measures  are  used  as  effective  measures  of  fuzziness. 
And  based  on  the  measure,  we  develop  the  criteria  for  fault 
feature  selection  as  well  as  fault  feature  classification 
and  diagnosis.  Fuzziness  is  a  type  of  imprecision  which 
stems  from  a  grouping  of  objects  into  classes  which  do  not 
lend  themselves  to  sharply  defined  boundaries.  A  basic 
difference  between  a  fuzzy  algorithm  and  a  heuristic  program 
is  that  the  instructions  in  a  fuzzy  algorithm  are  themselves 
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fuzzy  whereas  in  a  heuristic  program  they  are  not. 

The  secondary  part  of  this  study  focuses  on  a  review 
and  extension  of  some  of  the  graph  theoretical  aspects, 
especially  initiated  by  Berkowitz's  element  value 
solvability. 

2.2  Literature  Survey  and  Theoretical  Background 

Until  now,  efforts  at  producing  effective  algorithms 
for  automatically  generating  test  programs  have  been 
confined  mainly  to  digital  circuits  for  which  more  or  less 
satisfactory  solutions  have  been  reached.  Today,  industry 
uses  computer  programs  for  developing  and  analyzing  test 
sequences  for  printed  circuit  boards  built  with  MSI  and  LSI 
circuits.  Analog  circuits,  on  the  other  hand,  have  received 
much  less  attention  and  effort. 

The  main  difference  of  development  between  digital  and 
analog  systems  might  be  due  to  several  of  the  following 
reasons . 

1)  Fault  categories  as  well  as  their  statistical 

distributions  and  correlations  are  not  known  with  precision. 

2)  Even  though  theorectically  measurable-,  conventional 
automatic  test  equipment  has  its  own  limitation  of 
measurement  range. 

3)  Relations  among  input  and  output  signals  in  analog 
circuits  are  heavily  depending  on  the  network  structure. 

4)  Particularly  under  fault  conditions,  analog  systems  are 
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frequently  nonlinear,  and  involves  measurement  noise  and 
component  drifts. 

Therefore  the  rest  of  this  section  is  devoted  to  a  review 
of  existing  methods  with  answers  to  the  following  questions. 
Characterization  of  method.  What  kind  of  theoretical 
background  does  it  have?  To  which  analog  system  can  it  be 
applied?  The  following  classification  methods  are  from 
Duhamel  and  Rault  (15) .  For  convenience  we  consider  only 
three  categories. 

Estimation  Methods:  Two  general  classes  of  methods  belong 
to  this  category;  deterministic  methods  and  probabilistic 
methods.  The  first  ones  consist  in  determining,  from 
measurements,  the  actual  values  of  the  parameters  of  the 
UUT;  determination  may  be  purely  analytic  (based  on  analytic 
relations  between  input  stimuli  and  responses)  or  based  on 
estimation  criteria  (here  both  physical  and  mathematical 
conditions  are  taken  into  account) .  The  following  detailed 
methods  belong  to  this  first  class?  the  least  squares 
criterion  method  (16,17),  the  minimal  deviation  vector 
method  (18),  the  quadratic  programming  method  (19),  the 
voting  method  (3,5),  and  the  minimal  distribution  functions 
method  (20)  .  The  second  ones  are  probabilistic  methods.  In 
probabilistic  methods,  the  distribution  laws  of  measured 
responses  are  determined  from  the  tolerances  on  the 
parameter  values  and  their  associated  statistical 
distributions.  The  inverse  probability  method  is  one  of  the 
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typical  probabilistic  methods.  Theoretically,  estimation 
methods  have  as  main  advantages  the  fact  that  test-points 
are  the  input  and  output  connections  of  the  UUT,  fewer 
measurements  are  needed  than  parameters,  no  need  for 
omission  of  particular  faults  (unlike  taxonomical  methods) ; 
furthermore,  they  allow  savings  in  computer  memory  due  to 
the  use  of  analytic  relations.  Nevertheless,  these 
advantages  are  obtained  at  the  expense  of  the  computations 
to  be  done  at  the  moment  of  actual  test. 

Thus  introducing  the  fuzzy  set  concept  in  this 
estimation  method  and  application  to  fault  isolation  is 
essential  to  the  satisfactory  integration  of  various  fault 
isolation  methods. 

Topological  Methods:  The  basic  data  to  be  handled  are 
the  syt.  m's  structure  and,  possibly,  analytic  relations 
between  input  variables  and  measured  responses.  The 
information  path  analysis  method  (21,22),  the  maximal 
current  method  (23) ,  the  inverse  simulation  method  (24) ,  and 
the  graph  analysis  method  (25)  are  in  this  category.  The 
main  advantage  of  these  approaches  is  allowing  to  test  a 
single  system  or  large  portions  of  a  single  system  in  a  few 
steps.  Moreover,  they  may  be  used  as  a  preanalysis  to  probe 
technique.  In  our  study,  certain  graph  theoretical  aspects 
are  intensively  examined.  It  could  be  used  to  enhance 
preanalysis  to  applications  for  fuzzy  system. 

Taxonomical  Methods.:  They  are  based  on  a  fault 
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dictionary  in  which  are  stored  the  system's  reference 
responses  corresponding  to  each  potential  fault  condition. 
During  actual  testing,  measurement  results  are  compared  to 
the  responses  recorded  in  the  dictionary;  the  detected  fault 
is  the  one  for  which  the  set  of  measurements  differs  the 
least,  according  to  a  predetermined  criterion,  from  its 
corresponding  response  vector  in  the  fault  dictionary. 
Obviously,  the  accuracy  of  such  methods  is  directly 
dependent  on  how  comprehensive  one  is  able  to  make  the  fault 
dictionary.  Main  advantages  of  taxonomical  methods  are 
several  levels  of  description  (components,  functions, 
boards)  and  diagnosis  capability,  independence  with  respect 
to  technology  (several  types  of  measurements) ,  test  signals 
correspond  to  normal  operation,  capability  for  trend 
analysis,  off-line  or  on-line  testing,  no  assumption  on  the 
type  of  systems  (linear  or  nonlinear) .  Their  main  drawback 
lies  in  the  large  volume  of  data  to  be  processed,  fuzziness 
in  the  definition  of  fault  signatures,  and  the  risk  of 
overlooking  faults  not  included  in  the  fault  dictionary. 

2.3  Fuzziness  in  Analog  Electronic  Networks 

Recall  that  the  main  problem  is  isolating  fault  pattern 
classes  whose  analog  functions  are  degraded  by  the  faulty 
components  under  additional  constraints.  In  particular  the 
main  condition  is  that  all  the  nonfaulty  components  are 
subject  to  drift  within  prescribed  tolerances  and  the 
measurements  are  assumed  to  be  corrupted  by  noise.  Our  main 
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thesis  is  that  such  a  system  can  be  modelled  by  adopting  the 
fuzzy  set  theory;  in  particular  the  fuzzy  membership 
function. 

On  examining  this  concept,  some  researchers  simply 
assumed  that,  since  the  membership  function  takes  values  in 
the  closed  interval  (0,1),  the  theory  of  fuzzy  subsets  is  a 
variant  of  probability  theory.  In  fact,  this  is  not  the 
case.  Probability  theory  is  often  viewed  as  a  part  of  a 
general  theory  of  measure.  By  contrast,  fuzzy  set  theory 
falls  within  the  theory  of  "valuation"  {  in  this  sense, 
"fuzzy  measure"  should  be  distingushed  from  usual  use  of  the 
term  )  (49).  A  basic  property  of  measure  is  its  additivity. 
A  valuation,  on  the  other  hand,  exhibits  a  weaker  property 
of  monotonicity  with  respect  to  inclusion  and  thus  is  a  more 
general  notion  than  that  of  measure  (51). 

Many  of  the  electronic  and  feedback  control  systems  of 
interest  are  designed  to  perform  certain  specific  analog 
functions.  These  are  continuous  functions  and  the 
deviations  of  a  system  function  from  its  .  nominal  value  may 
range  between  an  upper  and  lower  bound  established  by  the 
physical  nature  of  the  system.  For  such  systems  a  slight 
out  of  tolerance  condition  yields  a  partial  failure  whereas 
large  deviations  usually  result  in  a  complete  failure.  The 
difficult  problem  is  to  diagnose  the  fault  when  a  component 
exceeds  the  nominal  value  to  an  extent  that  the  performance 
of  the  system  is  just  outside  the  specification  while  all 
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nonfaulty  components  are  subject  to  drift  within  tolerances. 
The  difficulties  are  compounded  by  measurements  corrupted  by 
noise.  Since  this  case  represents  the  "real  world" 
situation,  it  is  recognized  as  the  diagnostic  •test  case. 
Two  classes  of  well  known  analog  fault  diagnostic  methods, 
namely,  the  parameter  estimation  methods  (70,  71)  and  the 
bilinear  transformation  methods  (1,  2)  are  very  sensitive  to 
the  noise  and  the  nonlinearity  of  the  components. 

Thus  we  can  identify  the  problem  of  fault  analysis  as 
involving  two  highly  interactive  stages;  one  is  establishing 
the  set  of  test  measurements  to  characterize  a  fault  pattern 
and  the  other  is  the  construction  of  an  optimum  design 
procedure  to  classify  a  fault  pattern  based  on  these 
measurements. 


2.4  Fuzzy  Set  Theory 

The  fuzzy  set  concept  was  originated  by  Zadeh  (35) . 
Instead  of  taking  on  only  two  values  0  or  1  depending  on 
"included  in"  or  "not  included  in"  the  set,  the  basic  idea 
involves  taking  on  values  in  the  range  (0,1)  depending  on 
the  degree  of  belonging  to  the  set.  For  clarity,  some  of 
the  definitions  are  repeated  in  the  following  discussions 
(37,  39). 


Definition  2.1:  Let  E  be  a  set,  denumerable  or  not,  and  let 
x  be  an  element  of  E.  Then  a  fuzzy  subset  A  of  E  is  &et 
of  ordered  pairs 
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{x,  PA(x) }  ,  x  c  E 

where  uA  (x)  is  the  grade  of  membership  of  x  in  A.  Thus,  if 
uA(x)  takes  its  values  in  a  set  M,  called  the  membership 
set,  one  may  say  that  x  takes  its  values  in  M  through  the 
function  ma (x) .  Let  us  write 

x  - *  M  .  (2.4.1) 

This  function  will  likewise  be  called  the  membership 
function.  Three  major  operations  are  defined  as  follows. 
Definition  2.2;  Let  E  be  a  set  and  M»(0,1)  its  associated 
membership  set  and  let  A  and  B  two  fuzzy  subsets  of  E; 

V  xeE  j  uB<x)  »  1  -  pa(x)  :  A  and  B  are  complementary 

denoted  by  B»A,  (2.4.2) 

V  xc E  hJAn^x)  =  min  (|ja(x),  mq(x))  :  The  intersection  of  A 

and  B  denoted  by  AHB,  (2.4.3) 

V  xc  E  :^AuB(*)  "  raa*  (ma(x),  uB(x))  :  The  union  of  A  and  B 

denoted  by  AUB.  (2.4.4) 

Since  (0,1)  is  a  complete  lattice  (39),  we  can  define  in 
M(x),  unions  and  intersections  of  arbitrary  families: 


H\Ai 

(x)  *  infPAi <*) 

(2.4.5) 

i  ci 

id 

H&i 

(x)  «  sup^Ai  (x) 

(2.4.6) 

id 

id 

However  the  lattice  M(x)  is  not  a  Boolean  algebra  because 
AHA  *»(p,  ADA  *  E 

< P  stanas  for  empty  subset  of  E. 

Definition  2.3:  Fuzzy  implication  (Fuzzy  conditional 
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statement)  is  defined  as  follows. 

If  A  then  B, 

where  ACX,  and  BCY,  which  has  a  membership  function 
defined  by 

Mg(y,  X)  =  min  (|iA(x),  u  B  ( y ) )  .  (2.4.7) 

We  are  mapping  an  input  A  to  an  output  in  a  fuzzy  way. 

That  is,  input  is  big  then  output  is  medium,  given  ACX,  BCY. 

Let's  procede  two  description  of  a  system  in  fuzzy 

implication.  If  input  is  big  then  output  is  medium,  or  if 

input  is  medium  then  output  is  small,  i.e., 

If  Al  then  Bl,  or  if  A2  then  B2,  which  has  a  membership 

function  defined  by  ..  .  .. 

(2.4.8) 

Us(y#  x)  -  max  (min  (  »  Al  (x)  ,uB}  (y) )  ,  min  (p  A2  (x)  ,pB2  (y) ) ) . 

These  of  course  can  be  extended  to  more  than  two  fuzzy 
implications.  An  example  of  an  implication  extension  is  as 
follows . 

If  A  then  (  if  B  then  C) ,  whose  membership  is  defined  by 
Mg(x,  y,  z)  a  min  (  uA  (x)  ;  min  ( . n B  (y )  ;  \iQ(z))) 

=  min  (  nA(x)  ;  mb  (y)  ;  uc<z)).  (2  4  g) 

Definition  2.4:  Fuzzy  Inference;  To  calculate  the  inferred 
fuzzy  subset,  given  a  certain  implicand  fuzzy  subset. 

We  know  the  rule  :  If  the  input  is  big,  then  output  is 
medium.  The  question  is  :  If  the  input  is  very  big,  what 
will  be  the  output  knowing  that  the  preceding  statement. 
The  compositional  rule  of  inference  is  as  follows. 


I 

i 


m 


1 
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a 


m 


m 


16 

Given  a  fuzzy  implication  S  :  If  A  then  B,  the  fuzzy 
subset  B',  inferred  from  a  given  fuzzy  input  set  A'  (  A ,A'cx 
and  B,B'CY  ),  has  a  membership  function  defined  by 

uB,  (y)  3  max  min  (uA,  (x) ,  ug(y,  x)).  (2.4.10) 

Silvert  developed  some  more  fuzzy  operators  based  on 
symmetry  under  complementation^ ) .  Let  A^A^  represent  the 
combination  of  two  fuzzy  sets  A^  and  A^  under  some  rule,  and 
let  A  be  the  complement  of  Ar  If  »i  is  the  membership 
function  for  A,  then  the  membership  function  for  A  is 
uv  -  1- .  The  requirement  that  the  rule  of 

combination  be  independent  of  whether  we  deal  with  a  set  or 
its  complement  is  equivalent  to  the  condition 

(A1  °'~A~)  3  Ax  o  A2  .  (2.4.11) 

If  the  membership  function  l^2  for  the  set  Aj  oa^  is  given 
by  an  equation  of  the  form  2  -  C(Wj  ,  ;*2),  then  eq. 

(2.4.11)  is  equivalent  to 

1  ,  uj  =  C(l-u,  ,l-u0)  .  (2.4.12) 

j.  i.  l  i. 

A  symmetric  sum  will  be  considered  stable  if  and  only  if 

A  .*2  -  C^ul  m2^  -  Mi  V  u2  •  (2.4.13) 

Now  we  define  two  operators  A  and  7  .  Operator  A  is 

defined  as  choosing  the  membership  value  close  to  1/2, 

operator  V  is  defined  as  choosing  the  membership  value  far 
from  1/2.  If  we  confine  ourselves  to  add  the  associativity 
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and  stability  of  the  symmetric  sum,  above  operators 
satisfies  the  symmetry  under  complementation. 

Theorem  2.1:  A  and  V  are  operators  satisfying  the  symmetry 
under  complementation  with  the  associativity  and  stability. 


We  call  the  V  operator  as  the  extremum  (ext)  operator. 
We  can  also  denote  the  median  of  two  fuzzy  membership  values 
and  1/2  by  med  (y^#  ii2#  1/2).  Instead  of  using  relations 
we  can  also  use  ext-med  relations. 

2.5  Classes  of  Failures  in  Analog  Electronic  Systems 

We  can  categorize  the  potential  failures  according  to 
the  degree  of  system  failure  into  "soft"  failures  (deviation 
failures)  and  "hard"  failures  (catastrophic  failures) .  A 
"soft"  failure  indicates  that  some  components  exceed  their 
nominal  values  to  an  extent  that  the  performance  of  the 
system  falls  outside  the  specification.  A  "hard"  failure  on 
the  other  hand  indicates  a  large  deviation  in  the  system 
performance  due  to  the  catastrophic  change  of  components 
such  as  open  or  short. 

There  is  a  finite  set  of  nominal  measurements  X  =(xj, 
*2  >  ...»  Xj^ ,  ...»  Xp )  in  the  system  with  a  tolerance  \  x^ 
for  each  x^  ,  where  x^  stands  for  the  ith  port  measurement. 

is  the  fuzzy  set  of  all  possible  measurements  at  the  ith 
port  with  fuzzy  membership  values.  The  membership  value  for 


a  specific  measurement  means  the  degree  of  fault  assigned  to 
that  specific  port  measurement.  A  fuzzy  membership  value  of 
"1"  indicates  a  definite  hard  fault  while  a  fuzzy  membership 


value  of  "0"  indicates  no  fault.  Hence  an  intermediate 
fuzzy  membership  value  represents  the  degree  of  soft  fault 
indicated  by  the  measurement.  We  associate  fuzzy  membership 
values  corresponding  to  the  test  measurements  X  -  (x^  , 

x  ,  ...»  x.  ,  •  •  • ,  x  )  by 

i  i  n 


U  u  = 

X 


I  ||  o 
X1 


U  0 

x2 


U  0 

V 
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If  the  maximum  fuzzy  membership  value  of  the  test 
measurements  exceeds  u  ,  then  we  say  the  system  under  test 
is  at  least  in  t-failure. 

Another  important  distinction  is  between  the  single 
component  failure  case  and  the  multiple  component  failure 
case.  If  only  one  component  in  any  circuit  is  outside  the 
tolerance  limit  to  such  an  extent  that  the  response 
measurements  are  out  of  specification,  then  we  denote  the 
faulty  circuit  as  a  single  fault  case.  Similarly  if  more 
than  two  components  in  any  circuit  are  sufficiently  outside 
their  tolerance  limits  so  that  the  response  measurements  are 
out  of  specification,  then  we  denote  it  as  a  multiple  fault 
case.  Throughout  this  dissertation,  the  single  fault  case 
will  be  the  focus  of  study.  Until  now  the  multiple  fault 
case  has  not  been  studied  extensively,  mainly  because  of  its 


additional  complexity.  Whenever  multiple  fault  cases  are 
known  a  priori,  we  can  extend  our  methods  to  isolate 
multiple  fault  cases. 


2  0 

CHAPTER  3  Fuzzy  Automaton  Model  (FAM)  as  a  Basis  for  Fault 

Isolation 

3.1  Introduction 

The  concept  of  fuzzy  automaton  has  been  introduced  by 
Wee  and  Fu  (61)  based  on  Zadeh's  composition  of  binary  fuzzy 
relations.  Their  main  interest  was  the  application  to 
pattern  classification  as  a  model  of  learning  systems  in 
connection  with  the  nonsupervised  learning  problems  in 
automatic  control  and  pattern  recognition  systems.  Until 
now  fuzzy  automata  are  largely  used  ns  models  of  learning 
control  systems  (61),  linguistics  (45,46)  and  medical 
diagnosis  (SO) . 

The  fuzzy  automaton  developed  in  (61)  is  basically  an 
algebraic  system,  that  merely  replaces  a  deterministic 
input-output  relation  or  a  transition  of  states  by  a  fuzzy 
relation.  To  impact  on  actual  operational  systems,  we 
propose  a  baseline  system  whose  parameters  and  structures 
may  be  updated  by  learning  models.  Specifically  inputs, 
states,  and  outputs  are  first  subjectively  assigned  using 
fuzzy  membership  functions  and  then  the  automaton  model  is 
updated  through  the  use  of  operators  on  the  fuzzy  sets. 

Fault  isolation  techniques  for  analog  electronic 
systems  are  by  nature  imprecise.  Hence  it  is  quite  natural 
to  consider  a  fuzzy  automaton  as  a  model  of  fault  isolation 
or  automatic  fault  testing  in  analog  networks.  In  this  way, 
methods  of  handling  fault  isolation  based  on  the  fuzzy 

tv 
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automaton  become  much  broader  and  more  general  than  by  use 
of  the  conventional  method  reviewed  in  chapter  2.  We 
frequently  encounter  situat  ,^ns  in  fault  isolation  in  which 
the  procedure  is  not  precisely  specified.  Therefore,  it  is 
of  interest  to  investigate  algorithms  that  show  how  to 
achieve  from  imprecise  procedures  for  reasonable  fault 
diagnosis  results  under  the  framework  of  fuzzy  automata. 

Our  detailed  study  includes  the  following  topics  : 

1.  Development  of  simple  learning  methods  using  various 
fuzzy  relations  based  on  the  fuzzy  automaton  model . 

2.  The  conditions  for  convergence,  monotonicity  in  the 
above  approach. 

3.  The  learning  behavior  of  the  algorithms  using  fuzzy 
distance  measure  and  fuzzy  entropy  measure  assuming  little 
statistical  information  is  available. 

4.  Applicability  of  the  automatic  fault  testing  and  fault 
isolation  methods. 

3.2  A  Formulation  of  Fuzzy  Automata 

When  a  fuzzy  automaton  is  used  as  a  model  of  a  learning 
system,  the  elements  of  a  fuzzy  state  transition  matrix  and 
a  fuzzy  output  matrix  are  varied  via  a  linear  reinforcement 
scheme  or  fuzzy  relations.  In  this  manner,  the  fuzzy 
automaton  exhibits  a  variable  structure.  Wong  and  Shen  (62) 
have  modified  the  membership  functions  of  the  state  directly 
to  learn  the  parameter  values  that  maximize  the  expected 
value  of  a  noisy  multi-model  response  function.  The 


advantages  are  computational  economy  and  analytical 
convenience . 

When  we  consider  the  system  whose  structure  and  states 
are  imprecise,  a  finite  fuzzy  automaton  can  be  described  by 
a  sextuple  (X,S,Y,  h,f,g)  where 


X  : 

a 

set 

of 

inputs 

(xx  t  *2  *  •  •  •  #  f 

...,  xq) 

S  : 

a 

set 

of 

states 

(s^  f  S2  #  •  •  •  9  f 

***'  sm} 

Y  : 

a 

set 

of 

outputs 

(yi#  y2»  •••*  yj » 

. . . /  yr 

h  ;  membership  function  that  maps  (X,S)  into  closed 

interval  (0,1)  (initial  fuzzy  state  membership) 
f  s  membership  function  that  maps  (X,  S,  S)  into  closed 
interval  (0,1)  (state  transition  membership) 
g  :  membership  function  that  maps  (S,Y)  into  closed 

interval  (0,1)  (fuzzy  output  membership). 

The  above  is  a  formulation  close  to  the  Moore  type  fuzzy 
automaton.  The  fuzzy  membership  function  h  is  the  state 
membership  function,  h  assigns  to  each  pair  (xQ,  s.  )  c  X  x 
S  a  certain  fuzzy  membership  value.  It  is  a  fuzzy  mapping 

from  X  x  S  into  (0,  1)  such  that  for  (  xe,  s.  )  t  X  x  S,  e« 

1,2, .. .  ,q,  i»  l,2,...,n,  and  is  abreviated  as  h(xe,  s^)  = 
hei  ,  0  s  h0i  <  1.  The  fuzzy  membership  function  g  is  the 
output  membership  function.  The  output  may  be  the  decision 
to  classify  an  object  as  belonging  to  the  jth  fault  class  in 
a  fault  classification  problem.  It  should  be  noted  that  g 
is  a  fuzzy  mapping  from  the  state  si  to  y^  represented  by 
g(si#  yj ) .  The  fuzzy  membership  function  f  is  the  state 
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transition  membership  function,  f  defines  the  transition 
operator  characterizing  a  learning  automaton.  The 
assumption  here  is  as  follows.  1)  The  degree  of  fuzziness 
in  the  input  affects  the  change  in  the  degree  of  fuzziness 
in  the  state  through  the  state  transition  function  by  fuzzy 
relations  such  as  max-min,  nax-product,  linear-product,  and 
extremum-median  (ext-med)  fuzzy  relations.  2)  The  degree  of 
fuzziness  in  the  output  is  affected  by  the  change  of  the 
degree  of  fuzziness  in  the  state  through  the  output  fuzzy 
function  by  fuzzy  relations.  3)  The  state  choosing  scheme 
is  refined  by  the  reinforcement  scheme  us  ng  the  penalty  and 
reward  information. 

Usually  the  membership  functions  f  and  g  are  represented 
by  transition  matrices  Qn  (xe)  and  Gn  respectively.  When 
the  input  at  the  time  instant  n  is  x  ,  the  elements  of  fuzzy 
state  transition  matrix  Qn  (xe)  is  given  by 
f  (n  ;  xe,  si#  sk)  »  f(  x(n)  -  xQ ,  s(n)  =  si  ,  s(n+l)  =  sk  )  . 
where  i,k  =  l,2,...,m. 

Similarly,  the  element  of  the  output  fuzzy  matrix  Gn  at 
time  t  is  given  by 

g(n  ;  sk  ,  yj  )  *  g(s(n)  ■  ^  ,  y(n)  -  y ■  )  , 
where  j  3  1,2, ... ,r. 

To  be  strictly  correct,  variables  denoting  the  particular 
fuzzy  sets  should  be  attached  to  f  and  g  explicitly  but  they 
may  be  omitted  if  they  are  self-evident.  The  main 
implication  of  the  fuzzy  state  membership  is  as  an  index  of 
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vagueness  in  the  state  at  a  given  input.  The  main 
implication  of  the  fuzzy  transition  membership  and  the  fuzzy 
output  membership  is  as  an  index  of  vagueness  in  the 
procedure  due  to  the  degree  of  interaction  between  the  input 
and  the  state,  and  between  the  state  and  output  respectively 
constrained  by  the  fuzzy  operators.  Fuzzy  membership  close 
to  one  indicates  the  certainty  of  the  element  being  included 
in  the  class  while  an  element  value  close  to  zero  indicates 
the  certainty  of  the  element  being  excluded  from  the  class. 
At  the  time  instant  n,  suppose  that  the  fuzzy  automaton  is 
in  a  state  s^  with  the  grade  membership 

h(n  ;  xe*  si)  “  h(  x(n)  »  xe,  s(n)  =  s^  )  and  that  the 
input  to  the  automaton  is  x£.  Then,  the  choice  of  the  next 
state  given  that  the  previous  state  is  represented  as  a 
state  transition  performance  function  rf,  is  given  by 


rf  (n  ;  xe ,  sR)  =  VA(h(n  ;  xQ ,  si),  f(n~l  ;  xQ,  s^  ,  sR)) 

1  (3.2.1) 


where  A  is  an  inter  operator  and  V  is  an  intra  operator. 
Inter  operator  A  is  defined  as  an  operator  between  the 
corresponding  fuzzy  set  elements,  while  intra  operator  V  is 
defined  as  an  operator  among  the  chosen  set  of  elements 
using  inter  operator.  We  often  select  the  state  s,.  which 


satisfies 

rf  (n;  xe,sk  )  >  rf(n;  x  ,sk  ) 

max 


(3.2.2) 
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where  kmax  ¥=■  k.  The  state  sk  indicates  the  most 

max 

possible  choice. 

The  next  state  transition  membership  function  can  be 
updated  using  a  linear  reinforcement  scheme. 


f  (n+1 ;  xe,  sif  ^1=  af(n;  xe'si,sk)  +  (sk) 

if  correctly  classified 
otherwise  ( sk  )  *  0, 


(3.2.3) 


where  0  <  u  <  1 . 


Simlarly,  the  choice  of  the  output  represented  as  a  output 
performance  function  rg 

rg  (n  ;  ,  yj  )  =  V  A  (  g  (n  ;  3i  ,y^  )  ,  h  (n  ;  xq  ,  s±  ) ) . 

(3.2.4) 

The  next  output  membership  function  is  updated  using  linear 
reinforcement  scheme, 


g (n+1;  ^  , y-j  )  =  ag(n;  ,  y^  )  +  (1-u  )<,  (y^  ) 


(3.2.5) 


Jif  correctly  classified  (y.  ) 


3 


lotherwise  i|>  (y^  )  *  0, 
tfhere  0  <  a  »  1. 

In  order  to  simplify  the  problem,  when  the  set  of 
states  directly  exhibits  the  set  of  outputs,  we  can  choose 


-  -■a rpxZtrstjr 
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g(n;  s  ,y  ) =  II  k=j 

,  k*  j  . 

Therefore  the  nodification  of  h  or  f  or  g  gives  the  fuzzy 
automaton  a  variable  structure.  This  feature  of  variable 
structure  results  in  the  learning  behavior  of  the  automaton. 

Depending  on  the  choice  of  intra-inter  operators, 
namely  fuzzy  relations,  a  fuzzy  automaton  exhibits  a 
different  variable  structure.  The  method  of  direct 
modification  of  the  state  membership  functions  proposed  by 
Wong  and  Shen  (62)  can  be  included  as  a  special  case  of  the 
modification  of  the  state  transition  membership  function 
when  the  fuzzy  transition  membership  is  an  identity  matrix. 

It  is  interesting  to  note  that  according  to  the  definition 
of  membership  function,  "h"  does  not  reveal  too  much  about 
the  nature  of  the  function.  Thus  h  is  a  "grade  of 
membership"  function  keeping  the  order  of  state,  called  the 
ordinal  information  that  is  defined  for  each  xeX  and 
he (0 , 1) .  A  special  class  of  fuzzy  automata  would  have  the 
row  sum  of  all  transition  matrices  equal  to  unity.  This 
type  of  automata  can  be  called  the  normalized  fuzzy  automata 
which  may  retain  the  cardinal  information  during 
transformation  and  have  the  same  structure  as  the  stochastic 
automata. 

The  learning  model  (12)  applied  to  fault  classification 


is  formulated  as  follows:  Let  the  fault  classifier  consist 
of  several  set.s  of  preselected  discriminant  functions. 

These  are  characterized  by  sets  of  parameters,  for  instance, 

values  of  the  threshold  E  ' s  and  values  of  the  tolerance  on 

o 

performance  useu  to  detect  a  fault  mode.  Depending  upon 
whether  or  not  external  supervision  (a  teacher)  is  required, 
the  process  of  learning  is  classified  as  being  off-line  or 
on-line  learning  respectively.  Initial  assignments  of  fuzzy 
membership  values  are  "subjective”  and  "local"  (43).  By 
calling  the  values  subjective,  it  simply  means  assigning 
arbitrarily  which  values  of  the  "degree  of  fault"  (base 
logic)  belong  to  "degree  of  truth  values  to  the  above 
statements"  (which  linguistic  truth-values  to  what  degree) .  \ 

t 

By  local  values  we  mean  that  the  assignments  to  the  primary 
term  are  defined  only  for  a  specified  set  of  propositions. 

In  the  learning  process  with  external  supervision,  the 
correct  fault  condition  corresponding  to  a  measurement  is 
usually  considered  to  be  known  exactly.  Then  the  teacher 
directly  varies  the  fuzzy  automaton  structure  such  that  the 
decision  is  based  on  the  maximum  membership  grade  i.e. 

decide  jth  class  if  g(n  ;  s,  y^ )  =  max  g(n  ;  si ,  yk)  \ 

i 

Either  with  supervision  or  with  a  proper  specification 
of  the  performance  evaluation,  the  model  adapts  itself  to 
the  best  solution.  Here  the  best  solution  means  the  set  of 
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the  discriminant  functions  that  gives  the  minimum  number  cf 
misrecognized  faults  among  the  given  sets  of  discriminant 
functions  within  the  set  of  learning  samples.  On  every 
arrival  of  input  x  a  transition  may  be  executed  from  a  state 
s.  to  another  state  s,  or  the  same  state  s.  via  the  state 
transition  performance  function,  and  then  an  output  may  be 
sent  out  according  to  the  branch  in  which  the  transition  has 
been  executed. 

In  this  section,  the  formulation  of  a  fuzzy  automaton 
is  described  and  basic  learning  diagnostic  scheme  is 
presented.  In  the  subsequent  section  it  is  shown  how  fuzzy 
relations  end  linear  reinforcement  schemes  contribute  to  the 
learning  of  the  best  solution. 

3.3  Various  Fuzzy  Relations  in  Fuzzy  Automata 

To  model  a  fuzzy  system,  we  can  choose  the  f  jzzy 
automaton  as  a  baseline  model.  We  consider  inputs,  states, 
and  outputs  as  fuzzy  variables,  and  updating  the  structure 
by  using  fuzzy  relations  and  a  linear  reinforcement  scheme. 

There  are  many  ways  in  which  one  could  modify  a  given 
concept,  including  the  concept  of  automata  to  make  it  fuzzy. 
One  of  the  most  popular  way  is  to  use  the  maximum  and 
minimum  operators  as  a  fuzzy  relation.  The  model  of  fuzzy 
automata  obtained  in  this  manner  often  turns  out  to  be 
?.i  nilar  to  the  extensions  of  existing  deterministic  ones 
(63).  For  these  reasons,  we  investigate  various  fuzzy 
automata  depending  on  the  corresponding  fuzzy  relations 
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utilized. 

The  membership  function  for  a  path  in  which  a  higher 
order  transition  may  be  executed  from  a  state  s^  to  another 
state  Sj  or  the  same  state  via  serial  branches  is  calculated 
by  one  of  several  fuzzy  relations. 

Santos  (63,64)  discussed  classes  of  automata  obtained 
from  the  pseudo  automaton  by  a  rule  of  extension  and  a  set 
of  constraints.  In  his  discussion,  the  pseudo  automaton  is 
defined  as  a  single  length  input  with  a  state  transition 
function.  Rules  of  extensions  such  as  max-min  operators, 
max-product  operators,  linear  product  operators  are  used  to 
generate  an  atomaton  which  has  a  multiple  length  input.  We 
can  make  the  interpretation  that  each  new  fault  condition  in 
fault  isolation  corresponds  to  a  single  length  input. 
Therefore  our  FA  model  will  be  restricted  to  a  set  of  single 
length  inputs  as  possible  inputs. 

The  problem  of  fault  isolation  using  various  response 
deviation  measurements  is  basically  a  problem  of  vector 
optimization.  lor  example 

Q(c)  =  {  Q  (c) ,Q  (c) , . . . ,Q.  (c) , . . . ,Q  (c) f  min, 

12  l  m 

where  (c)  (i=l,2, . . . ,m)  are  the  elements  of  vector  loss 
function  which  represents  the  loss  incurred  by  the  decision 
as  ith  single  fault,  and  c  is  unknown  parameter  vector. 

We  are  interested  in  determining  some  of  the  possible 
combinations  of  operators  as  fuzzy  composite  relations  that 
may  yield  better  fault  isolation  for  the  application  of 
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fault  analysis.  They  are  max -min  operators,  max-product 
operators,  linec.r  product  operators  ,  and  ext-med  operators. 

3.3.1  Max-min  Composite  Relations 

Following  a  general  formulation  of  FA  given  in  section 
3.2,  we  now  show  how  effective  max-min  relations  are  when 
used  to  direct  the  learning  of  the  fuzzy  automaton.  We 
generally  denote  the  composition  of  the  two  fuzzy  set  as 
A°B.  Max  min  fuzzy  relations  are  defiled  as  follows. 

VB<x'y)=  Ir,a:t  min  UB (z*y> ) ,  v  (3.3.1) 

where  A  and  B  are  both  fuzzy  sets. 

When  we  apply  the  above  equation  in  the  composition  of  a 
fuzzy  set  AoA,  we  get 

MAl)A(x,y)*  min  '  UA  (2*y) )  •  (3.3.2) 

This  fuzzy  relation  is  explained  as  follows  (61)  .  (  The 

pessimistic  case  is  being  considered  when  the  minimum 
function  is  selected  between  uA(x,z)  and  u  ( z,y)  and  the 
maximal  grade  of  this  minimum  is  being  searched  through  z.) 
It  is  easy  to  prove  that  the  result  of  using  max  min 
relations  is  equivalent  to  the  use  of  min  max  relations 
having  a  monotonicity  property  in  the  fuzzy  set  A  through 
variable  z. 

Since  the  state  transition  function  f,  the  initial 
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state  membership  function  h,  and  the  output  membership 
function  g  may  be  interpreted  as  the  grade  of  membership 
functions  of  fuzzy  sets,  we  can  define  the  state  transition 
performance  function  of  the  automaton  as  follows. 

(3.3.3) 

rf  (n:  x  ,  s,  )  -  max  min  (h(n;  x  ,  s . )  ,f  (n;  x  ,  s .  ,  s,  ) ) 

e  k  ^  ei  eik 

Likewise,  the  output  performance  function  of  the  automaton 
is  defined  as  follows. 

rgm;  xe,yj)  »  max  min  (h(n;  xe,si),  g(n;  s^y^)).  (3.3.4) 

3.3.2  Max-product  Composite  Relations 

The  idea  of  max-product  fuzzy  relation  is  to  choose  the 
transition  path  which  yields  the  maximum  of  the  product  of 
the  fuzzy  memberships  between  the  two  fuzzy  sets. 
Max-product  fuzzy  relations  of  the  state  transition 
performance  function  rf  and  the  output  performance  function 
eg  can  be  defined  as  follows. 

rh  ( n ;  xe,sk)  <=  max  {h(n;  xe,si)*f(n;  xe  ,  s  ^ ,  sR ) )  (3.3.5) 

and 

rg(n;  xe,y^)  =  max  (h(n;  xe,si)*g(n;  s^y.))  (3.3.6) 

Theorem _ 3.1)  Max-product  operator  is  not 


i 


-w -.■...■i— ly..  jmuu.™  —  |  |  |  |  |  |  |  |  j  |  yjlAn^vnfflfWBffl  lln  III  I 


32 

log-  interchangaMe . 

Proof. 

log  h(n+l  ;  x)  =  log  max  (h(n  ;  x)*f(n  ;  x,  3.,  s,  ) ) 

1  K 

1 

=  max  log  (h(n  ?  x)*f(n  ;  x,  s. ,  sR)) 
i 

=  max(log  h(n  ;x)+log  f(n  ;  x,  s. ,  s  )) 

.  1  K 

1 

*  max  log  h(n  ;  x)*log  f(n  ;  x,  s.  ,  3,  ) 

1  K 

1 

Using  above  relations  we  are  able  to  choose  the  maximum 
of  the  two  product  fuzzy  membership  sets.  The  important 
point  is  that  the  set  can  be  ordered  under  the  above 
structure.  It  is  easily  noticed  that  the  value  of  fuzzy 

membership  for  rh(n;  x  , s,  )  conveys  the  information  of  the 

G  K 

average  (central  tendency)  in  the  sense  of  geometry. 

3.3.3  Linear  Product  Composite  Relations 

As  another  possible  fuzzy  relation  we  can  choose  the 
transition  path  which  yiele  s  the  average  of  the  product  of 
the  fuzzy  memberships  between  the  two  fuzzy  sets.  Linear 
product  fuzzy  relations  of  the  state  transition  performance 
function  rh  and  the  output  performance  function  rg  can  be 
defined  as  follows: 


rh(n;  xo,sR) 
and 

rg(n;  xe,yj) 


(h(n;  xe,si)  *  f(n;  xe,s.,sk)) 
i 


'  (h (n;  xe,s.) 


g  (n ;  ^  >y j ) )  * 


(3.3.7) 


"k 


(3.3.8) 
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where  h  is  used  as  an  average  operator.  This  relation  is 
very  similar  to  that  of  stochastic  automata. 

3.3.4  Max-topology  Composite  Relations 

One  other  interesting  class  of  fuzzy  composite 
relations  is  defined  as  max-topology  composite  relations, 
when  we  have  restrictions  between  the  two  fuzzy  set  given  by 
some  topological  relations.  We  can  choose  the  transition 
path  which  yields  the  maximum  while  satisfying  the 
topological  restrictions.  Max-topology  fuzzy  relations  for 
rh  and  rg  are  defined  as  follows. 

rh(n;  xe,sk)  =  F(h(n;  x^s^,  f(n;  xe,sifsk))  (3.3.9) 

and 

rg  (n;  xe,y.i)  =  G(h(n;  Xg^),  g(n;  si(y.)  (3.3.10) 

where  fuzzy  function  F  and  G  are  induced  by  the 
restrictions  of  the  topology  of  the  two  fuzzy  sets. 

3.4  Properties  of  Fuzzy  Relations  in  Fuzzy  Automata 


3.4.1  Simplicity 

Applications  of  fuzzy  relations  can  be  evaluated  by  the 
required  time  or  space  to  solve  a  given  problem.  We  would 
like  to  formulate  the  problem  as  seeking  the  lower  bound  of 
complexity  given  by  the  fuzzy  relation 
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£  ( x ; y )  -  v  a  (  f  ( x ,  z )  ,  f  (z,y))  (341) 

where  the  number  of  elements  of  the  set  A  is  mxn,  and  while 
that  of  set  B  is  nx*.  The  criterion  used  is  the  time  needed 
by  an  algorithm  expressed  as  a  function  of  the  size  of  the 
problem.  We  assume  that  operands  are  real  numbers  and  the 
basic  operations  are  +  ,  x,  max,  min,  y.  ,  a  ,  y  ,  where  a, 
and  V  are  defined  in  the  previous  chapter.  For  the  brevity 
of  comparisons  ve  further  assume  that  m  *  x  3  1. 

(i)  max  min  fuzzy  relations 

£.  _(x,y)  »  max  min  (  f.(x.z),  fB(z,y))  (3.4.2) 

The  above  fuzzy  relational  equation  has  n  comparisons 
between  the  two  values  to  get  the  minimum  values  and  one 
comparison  among  the  n  values  to  get  the  maximum  value.  In 
the  worst  case,  one  comparison  among  the  n  values  is 
equivalent  to  (n-1)  comparisons  between  the  two  values.  In 
sum,  max-min  fuzzy  relational  equation  has  less  than  or 
equal  to  (2n-l)  comparisons. 

(ii)  max  product  fuzzy  relations 

£AoB(x,y)  =  maX  (  fA(X/Z)  *  fB(Z'y))  (3.4.3) 

z 

We  need  n  products  and  one  comparison  among  the  n  values  to 
get  the  maximum  value.  In  sum  max  product  fuzzy  relational 
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equation  has  less  than  or  equal  to  n  products  and  (n-1) 
comparisons . 


(iii)  linear  product  fuzzy  relations 


W*'*’  -  1  *  V2'y) 

Z 


(3.4.4) 


We  need  n  products  and  (n-1)  additions, 


(iv)  VA  fuzzy  relations 


fAoB(x,y)  =  VA  <fA(x'z)'  fB(z*y)> 


(3.4.5) 


Recall  that  V  operator  is  the  operator  which  picks  the 
value  far  from  1/2  and  operator  A  is  the  operator  which  picks 
the  value  close  to  1/2.  To  perform  the  a  ooeration,  we  need 
one  addition  and  two  comparisons.  First  we  add  two  values 
fA(x,z)  and  fR(z,y).  Comparison  of  the  two  values, 
comparison  of  the  sum  of  the  two  values,  and  one  addition 
will  perform  the  operator.  Therefore,  in  total,  we  need  2n 
comparisons  and  n  additions  to  perform  operators.  To 
perform  the  V  ooeration,  we  need  (n-1)  comparison  to  pick 
the  maximum  and  minimum  values.  We  need  one  addition  and 
two  comparisons  to  pick  one  of  the  above  values.  In  total 
we  need  (n+1)  comparisons  and  one  addition  to  finish  y 
operations.  fuzzy  relational  equation  requires  (3n+l) 
comparison^  and  (n+1)  additions.  Notice  that  in  the 
microprocessor,  addition  and  comparison  take  two  cycles 
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while  multiplication  has  to  have  few  more  cycles, 
condense  the  above  results  into  the  following  table. 


Number  of 
Additions 

Number  of 

Multipl ications 

i 

2n 

- 

ii 

n 

n 

iii 

n 

n 

iv 

4n 

- 

Roughly  speaking,  we  can  order  the 
basis  of  needed  calculation  time, 
table  entries  ordered  as  follows: 

(i)  •'  (iv)  >'  <ii),  {iii) . 


fuzzy  relations  on  the  I 

1 

Thus  we  have  the  above  I 


3.4.2  Convergence  in  Linear  Reinforcement  Scheme 

Wo  are  dealing  with  the  problem  of  "learning"  in  an 
unknown  environment,  i.e.,  where  the  function  to  be 
"learned"  is  known  only  by  its  form  over  the  observation 
space.  This  implies  that  any  desired  solution  which  needs 
the  knowledge  of  the  function  to  be  approximated  is  reached 
gradually  by  methods  relying  on  experimentation  and 
observations.  If  on  the  other  hand  we  can  assume  that  the 


form  of  the  function  to  be  approximated  is  known  precisely, 
then  we  can  approach  the  problem  with  stochastic 
approximation  technique.  There  are  cases  when  no  assumption 
can  be  made  or  the  possible  form  of  the  function  to  be 
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"learned".  For  the  solution  to  be  found  by  stochastic 
approximation  technique,  the  existence  of  the  estimated  or 
approximated  unknown  quantities  must  be  assumed. 

When  the  unknown  environment  is  dominated  by  the 
vagueness  rather  than  randomness,  we  have  to  make  use  of 
observed  information  mainly  to  unveil  the  vagueness.  In 
some  cases,  fuzzy  relations  with  linear  reinforcement  scheme 
can  be  used  to  remove  some  of  the  vagueness  in  the  unknown 
environment.  Based  on  the  fuzzy  automaton  described  in  the 
section  3.2  and  3.3,  we  can  compare  the  convergence  property 
of  various  fuzzy  relations.  We  have  defined  the  state 
transition  performance  function  rf  as  the  result  of  the  set 
operated  on  the  state  membership  functions  and  the  state 
transition  membership  functions. 

From  eq.  3.2.1, 

rf(n?xe,sk)  *  VA(h(n;  Xq, s ,  f  (n-1;  xe,si,sk)) 

where  i  =  1,2, ... ,m 

-  V  (  A  (htn,^  ,si  ) ,  f  (n-1 ;  xe,si,si)), 

(h(n;xe,si),  f(n-l;  xe,si,sk))) 
where  i  =  l,2,...,m,  i  *  k. 
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f(n;  x  ,s.  ,s,  )  =  c(n;  x  ,s,  )  for  all  i  ^  k 

e  i  k  e  k 

and  f(n;  xe/sk'3k)  =  akf(n-l;  \»sk»sR)  +  <l-cxk ) XR 

with  f(n;  x  ,s  ,s,  )  =  c(n;  x  ,s,  )  «fo  if  n  is  odd 

e  l  k  e  k  J 

l  f  (n-1;  x  ,  s  , s  )  if  n 

G  K  K 

is  even, 

where  0<  i,  *  1 ,  0  <  ,\,  <  1 ,  k  **  1,2 , . . .  ,m. 

k  k 

Furthermore,  let 

h (n+1;  xe,sk)  =>  rf(n;  xe,sk>  if 

(f  (n;  xe,sk,  sk)-rf  (n;  xe,sR)*bn 

f(n;  x  ,s.  ,s.  )  +  an,  otherwise. 

e  k  k 

where  |an|<|bn|,  and  bn  is  bounded  sequence  such  that 
bn  '  0  as  n  -  . 

Therefore  an  0  as  n  +  With  this  assumptions,  h(n+l; 
x  , s,  )  is  always  between  0  and  1.  When  we  have  a  perfect 

G  K. 

teacher,  fuzzy  state  membership  function  h(n+l,  x  ,s,  )  with 

e  k 

max-min  relations,  max-product  relations,  and  linear  product 
relations  converges  to  *  ,  k=l,2,...,m. 

K 

As  an  example  for  the  comparison  of  various  fuzzy 
relations,  when 

1  _  .  _  _1__ 
an  4n  '  n  2n  ' 


hl = 

0.5 

«* 

1—* 

II 

r 
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0.8 

*•  i 
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0.8 
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>  4 

The  learning  curves  for  three  fuzzy  relations  are  showed  in 
Fig. 3.1.  After  13  steps  all  the  learning  curves  converges 
to  A  with  an  error  within  1%. 

Above  convergence  property  can  be  varied,  as 

h (n+1;  xe,sk),  depends  on  f(n;  xe,sk,sk)  and  c(n;  x^,s^) . 

The  typical  learning  curves  with  an  unreliable  teacher  are  \ 

shown  in  Fig.  3.2,  3.3,  3.4.  In  this  example,  the 

5 

asumptions  made  are  the  same  as  in  the  perfect  teacher  case 
except  Ak  is  estimated  and  updated  by  the  success  or  failure 

•  X 

\ 

of  the  decision. 

We  showed  in  this  section  that  the  state  membership 
function  together  with  various  fuzzy  relations  will  converge 
using  the  linear  reinforcement  scheme. 

3.4.3  Monotonicity  property 

One  of  the  important  aspect  of  using  fuzzy  membership 
function  is  the  monotonicity  property.  Usually  the  absolute 
values  of  fuzzy  membership  themselves  have  relatively  little 
meaning,  while  the  order  of  the  values  is  rather 
significant.  Most  of  the  decision  is  based  on  the 
cummulative  aspects  of  the  ordering  of  the  fuzzy  membership 
values.  New  fuzzy  set  is  generated  by  the  composition  of 
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two  fuzzy  sets  using  a  fuzzy  relation. 

f :  A  x  B  ■>  C 
with  fAOfH  -  tc, 

i.e.,  a  fuzzy  relation  f  maps  two-tuples  of  elements  in  the 
fuzzy  set  A  and  two-tuples  of  elements  in  the  fuzzy  set  B 
into  two-tuples  of  elements  in  the  fuzzy  set  C.  Several 
types  of  fuzzy  relations  are  discussed  in  the  earlier 

sections,  such  as  max-min,  max-product,  and  linear-product 
relations.  We  can  extend  these  binary  fuzzy  relations  to 

n-ary  relations  by  successively  applying  the  binary  fuzzy 

relations.  When  the  fuzzy  membership  is  drastically 
restricted  to  only  one  and  zero,  this  problem  reduces  to  a 
certain  type  of  the  switching  theory  problem  (87). 

For  ma)  -min  composite  relations 

fAoB(x'y)  77  min  (fA(x,z),  f  B  ( z ,  y ) ) , 

fAoB(x,y)  is  a  nondecreasing  function  of  fA(x,z)  and 

fR(z,y)  for  all  fA,  fg  e  (0,1). 

Proof,  if  f  A  ( x ,  z )  >  ^*(z,y)  then 

=  max  min  (f  (x,z),  f  (z,y))  -  max  min  (f,*(x,z),  f  (z,y)) 

£  D  2  A w  B 
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-  max  (  min  (fA(x,z),  fB(z,y))  -  min  (f^(x,z),  fB(z,y))) 

Z 

For  all  z 

1)  if  fA(x,z)  <  fB(z,y) 

then  T(z)  -  fA(x,z)  -  fA*(x,z)  >  0, 

2)  if  fA(x,z)  >  fB(z,y) 

then  min  (fA(x,z),  fB(z,y))  -  fB(z,y), 

a)  if  fA*  (x,z)  >  fB(z,y), 

then  min  (fA,(x,y),  fB(z,y)>  **  fB(z,y) 
and  T (z)  -  ffi  (z,y)  -  fB(z,y)  -  0, 

b)  if  fftik  (x,z)  <  fQ  (z  ,y)  , 

then  T(z)  -  fB(z,y)  -  fAA(x,z)  >  0. 

Therefore  fAQB  (x,z)  2  fA*oB(x»z>* 

Similarly  if  fg(z,y)*  f0*(z,y) 

then  J  fA0B*<2,),>  qed- 

For  composite  relations 

fA0B<x»y)  55  mJx  fA(x,z)  *  fB(z,y), 

fA0B  <x.y)  i-s  a  nondecreasing  function  of  f  (x,z)  and 
fB(z,y)  for  all  f A  ,  f B  e  (0,1). 

Proof  If  fA(x,z)  2  fA*  (x,z)  then 

4ob  <x»y)  "  4*ob  (x*y) 

"  max  fA(x,z)  *  fB(z,y)  -  max  fA*(x,z)  *  fB(z,y) 

2  2 


max  ((fA(x,z)  -  fA.  (x,z))  *  ^(z,y)) 
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Since  0  $  fB(z,y)  £  1,  for  any  z, 

(fA(x,z)  -  fA*(x,z))  *  fB(z,y)  *  0. 

Therefore  if  fB(z,y)  *  fB*(z,y)  then 

fAoB<x»y)  *  fAoB*(x«y>  *  °-  <ied- 
For  linear  product  relations 

fA0B(X’y>  •  ifA(X'2)  * 

where  i  is  used  as  an  averaging  operator,  ^A0e^x,y^  ds  a 
nondecreasing  function  of  fA(x,z)  and  fB(z,y)  for  all 
fA*  fB  e  (0.1). 

Proof  is  similar  to  the  max-product  case. 


M 

i 


i 
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3.5  Learning  Techniques  Applied  to  Active  Linear  Networks 
using  Frequency  Domain  Analysis 

3,5.1  Introduction 

This  section  addresses  the  problem  of  applying  learning 
techniques  to  fault  diagnosis  in  realistic  situations  where 
component  drifts  and  measurement  noise  must  also  taken  into 
consideration.  In  particular,  the  fuzzy  concent  of  Zadeh  is 
used  as  a  framework  for  fault  classification.  Further, 
fuzzy  automata  are  used  as  learning  models  to  select  the 
best  set  of  parameters  for  fault  tests,  because  they  have 
the  advantage  of  simplicity  and  straightforward  computation. 
An  example  of  this  learning  technique  is  applied  to 
simulated  faults  on  a  simple  active  circuit. 

There  are  essentially  three  fundamental  problems 
involved  in  achieving  effective  automatic  generation  of 
fault  isolation  tests  for  analog  systems:  feature 
extraction,  fault  classification  and  diagnosis. 

(1)  The  feature  extraction  problem. 

Given  a  faulty  pattern,  say  a  set  of  input -output 
signals,  we  must  be  able  to  extract  from  these  signals  the 
information  called  signal  attributes,  which  not 
only  proper ly  characterize  the  fault,  but  also  are  amenable 
to  automatic  processing  and  computation.  In  fact,  the 
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development  of  an  automatic  test  generation  system  is 
greatly  influenced  by  the  type  of  features  or  fault 
signature  selected  for  use.  A  well  known  signature 
describing  the  state  of  the  system  in  time  domain  testing  is 
the  input-output  cross  correlation  function  (3,26,27,28). 
Pseudo  random  binary  sequences  are  shewn  to  have 
approximately  the  required  impulse  autocorrelation.  They 
have  an  important  advantage  over  white  noise  perturbation 
methods  (30)  in  that  such  sequences  are  not  subject  to 
statistical  variation  and  can  be  easily  realized  by  using 
feedback  shift  registers.  In  frequency  domain  testing,  the 
use  of  gain  and  phase  measurements  at  selected  frequencies 
is  widespread  (5,29,30,31,32).  It  has  been  suggested  that 
the  transfer  functio..  ,  arameters  can  also  be  used  as  a  fault 
signature  but  it.  has  the  disadvantage  of  requiring  complex 
computations  to  convert  input-output  samples  to  transfer 
function  parameters  (33). 


(2)  The  fault  classification  problem. 


A  set  of  r  test  features,  which  characterize  a  number 
of  identifiable  failure  modes,  is  chosen  to  form  the 
coordinates  of  a  feature  space.  Assume  each  faulty  pattern 
: ^  represented  by  a  binary  vector  whose  components  are 
depending  on  whether  each  feature  is  present  or  missing  in 
that  pattern.  The  vertices  of  a  set  of  a  typical  feature 
space  are  labeled  and  a  set  of  hyperplanes  is  used  to 
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partition  the  feature  space  so  that  no  region  contains 
vertices  corresponding  two  or  more  different  fault  types. 
Unknown  fault  patterns  are  then  classified  as  belonging  to 
the  type  corresponding  to  the  prearranged  pattern  in  the 
region  in  which  they  fall.  The  correlation  method  starts 
from  the  same  presentation  in  that  a  set  of  typical  patterns 
represented  by  binary  vectors  in  the  feature  space  are  taken 


as  references.  The  unknown  patterns  are  then  correlated  3 

I 

* 

with  these  references  and  classified  as  belonging  to  a  I 

i 

particular  reference  pattern  according  to  the  highest  degree  $j 

| 

of  correlation.  1 


(3)  The  diagnosis  problem. 

The  ability  of  the  fault  classifier  to  determine 

correctly  the  type  of  new  patterns  of  unknown  classification 
is  most  appropriately  stated  in  terms  of  probability  of 
correct  diagnosis.  Put  another  way,  we  wish  to  determine 
P^'ilX)  a  probability  that  the  given  test  data  or  feature  X 
belongs  to  fault  type  The  measurements  are  assumed  to 

have  certain  distributions  p(x)  w  i ) ,  i=l,...m.  Furthermore, 
there  is  a  certain  probability  of  occurrence  of  type 
patterns,  P  (e  i ) .  The  key  information  required  to  make  a 
diagnosis  for  a  pattern  is  clearly  contained  in  the  function 
Pf*»i  |X)  which  is  determined  by  the  application  of  Bayes’ 


$ 

3 


rule: 


(3.5.1) 
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P(io.)  p{X|u.) 
p  ( <i> i  |  X)  =  - 

?P(w.)p(xU. .) 

i  *1 

j=i  3 

In  the  simple  case  of  and  to2  ,  the  likelihood  ratio  test 
which  is  optimal  under  various  assumptions  on  the  cost  of 
misclassification  is  given  by 

pfiojx)  >  n  classify 

,  I  .  .  .  c  (3.5.2) 

p  (o>2  I X)  <  n  classify  u>2 

where  is  some  suitably  chosen  constant.  The  crucial  step 
is  the  determination  of  p(<A^  |X)  since  it  directly  determines 
the  chance  and  cost  of  future  correct  diagnosis.  The  main 
difficulty  is  that  the  computation  and  information  required 
for  equation  (3.5.1)  in  a  practical  situation  involving 
component  drift  and  measurement  noise  are  extremely 
difficult  to  acquire.  If  the  probability  densities  are  not 
analytically  expressible,  their  values  at  each  point  in  the 
feature  space  must  be  stored  and  tabulated.  However  this 
process  requires  excessive  storage  space. 

The  so  called  "template  matching  technique"  for  fault 
diagnosis  has  a  lack  of  flexibility  since  it  rarely 
tolerates  noise  and  distortion  due  to  drift  of  components. 
A  fault  diagnostic  scheme  incorporating  learning  will  be 
more  effective  and  more  flexible.  In  this  section  we 
discuss  the  fuzzy  set  concept  of  Zadeh  and  its  application 
to  fault  classification  with  the  help  of  learning 
algorithms.  Further  we  propose  that  the  fuzzy  automaton 
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will  serve  as  a  convenient  learning  model  for  fault 
diagnosis. 


3.5.2  Fuzzy  Sets  and  Fault  Classification 


The  essential  function  of  a  fault  classifier  is  to 
recognize  the  membership  of  samples  which  belong  to  one 
fault  type  and  to  distinguish  among  them  the  different  fault 
types  even  though  the  boundaries  between  alternatives  is  not 
sharply  defined.  Hence  the  task  of  classifying  samples  into 
a  finite  number  of  fault  types  can  be  conveniently 
established  around  the  notion  of  "belonging"  in  the  case  of 
fuzzy  sets  (48) .  A  fuzzy  set  (class)  in  the  space  is 
represented  by  a  characteristic  function  f  ^  (X)  which 
associates  each  point  in  a  value  in  the  interval  [0,1],  with 

the  value  of  f  (X)  at  X  representing  the  "grade  membership" 

wi 

of  X  in  uk  .  In  order  to  generate  a  set  of  discriminant 

functions  for  fault  types,  it  is  convenient  to  introduce  a 

single  level,  or  two  levels  which  lead  to  two-valued  logic 

or  three-valued  logic.  Fo  simplicity,  consider  two  fault 

types  w  and  .  At  this  point,  we  introduce  two  levels  a 

and  8  (  0  u  <  1,  0<3<l,a>B).  At  level  a,  the  two 

types  may  be  disjoint  or  separable  and  at  level  S  (*•«),  they 

may  be  joint  or  not  separable  in  the  sense  of  ordinary  sets. 

We  then  decide  that  (a)  X  t  if  f  ( a )  5a  and  f  ( a )  <  a 

W2 

and  (b)  A  e  if  f  (A)  <  a  and  f  (A)  5  a  . 

2  W1  w2 

Notice  that  when  the  level  falls  below  p  ,  X  has  an 


This  fuzzy 


indeterminate  status  relative  to  and  w'2  . 
intersection  when  and  w2  are  not  separable  must  be 
identified  and  the  grade  of  membership  estimated  for  each  X 
in  this  section.  This  task  can  be  accomplished  by  adopting 
learning  procedures  to  generate  the  discriminant  functions. 


(1)  Generation  of  discriminant  function  by  learning. 

If  we  use  small  p{  |  X)  as  a  discriminant  function 

and  identify  it  with  f  (X) ,  the  problem  is  one  of 

wi 

reconstructing  a  function  from  a  knowledge  of  its  values 
ever  a  collection  of  samples  or  observations.  To  do  so,  one 
must  have  a  priori  information  about  a  type  of  functions  to 

which  f  (X)  belongs.  Then  this  information  in  combination 

i 

with  the  learning  samples  would  be  sufficient  to  enable  one 

to  construct  a  good  estimate  of  f  (X)  (48).  Let  us  assume 

wi 

that  f^  (X)  can  be  represented  by 


_  ,  .  n+l  t 

f  (x)  =  l  W.  .X  .  =  X  W. 
“i  j=l  13  3  1 


(3.5.3) 


where  Xn+1  is  one  and  X..  is  the  j-th  element  of  sample  X. 
Again  consider  two  types  and  <*>  .  The  problem  is  to 

determine  a  solution  with  vector  W  such  that  the  cross 
product  of  /ector  X  and  W,  X^W>0  for  all  patterns  of  type 
and  XTW<0  for  all  patterns  of  <^  .  Let  ! N  be  the  total  number 
of  augmentei  samples.  Also  let  the  matrix  whose  elements 
are  generated  by  test  samples: 
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>1 


(3.5.4) 


and  assume  that  all  X's  belonging  to  u>  have  been  multiplied 
by  -1.  The  problem  then  reduces  to  determining  W  such  that 

xw>0. 


According  to  Ho  and  Kashyap  (34),  a  minimum  mean  square 
error  hyperolane  can  be  generated  even  if  the  samples  are 
not  linearly  separable  by  minimizing  the  criterion  function 


J  =  ^  II  XW  -  b  II  2 


(3.5.5) 


with  respect  to  both  W  and  b,  where  b  is  an  N-vector  whose 


components  are  all  positive  where 


stands  for  a  distance 


criterion.  Setting  to  zero  the  gradient  of  J  with  respect 
to  W  yields  w  =(xTX)_1XTb  =  X+b  where  x+  is  the  generalized 


inverse  of 


The  positivity  constraint  on  b  is  fulfilled 


by  the  following  iteration  of  b. 


b(k+l)  =  b(k)  +  «b(k) 


where 


(3.5.6) 
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j  2c[Xw(k)-b(k)l  i  if[Xw(k)-b(k)l  ±>  0 
5bi(k)  =  (3.5.7) 

lo  if(Xw(k)-b(k))  ±<  0 

the  index  i  refers  i-th  component  of  the  vector,  and  c  is  a 

constant  such  that  0  <  c  <  1. 

In  vector  form,  equation  (3.5.7)  becomes 

6b(k)  =  c(XW(k)-b+|XW(k)-b| ]  (3.5.8) 

The  iterative  learning  algorithm  is  given  by 

W(k+1)  =  W (k)  +  cX+6b(k)  (3.5.9) 

and 

b (k+1)  =  b(k)  +  c6b(k) 

(3.5.10) 

W(l)=X+b(l) ,  b ( 1) > 0 , 

otherwise  arbitrary. 

(2)  Separation  of  the  fuzzy  section. 

Once  the  minimum  mean  square  error  hyperplane  H  has 
been  determined,  separating  boundaries  are  generated  to 
contain  only  the  learning  samples  belonging  to  the  complete 
fuzzy  section.  This  is  accomplished  by  a  search  among  the 
misclassifiod  samples  for  the  minimum  and  the  maximum 
distances  from  H.  Let  the  hyperplane  H  be  represented  by 


56 


d(X)  =  XTW  +  W  (H)  =  0 


(3.5.11) 


and  the  two  separating  boundaries  by 


x  W  +  Wn+1(H!)  =  0 
XTW  +  "n+1(H2)  =  0 


(3.5.12) 


the  distances  from  the  origin  to  and  H2  are  given  by 


and 


WH1> 

|w| 

WV 

I W I 


Vi(H) 

|W| 

Wn+1(H) 

|W| 


-  d 


max 


-  d  . 
min 


(3.5.13) 


it  follows  that  the  two  equations  of  and  H2  are 


Hl=  X  W  +  Vi(H)  -  lwla 


max 


(3.5.14) 


H,:  X  K  +  wnW(H)  -  |w|dmi 


mm 


Now  the  samples  belonging  to  and  the  samples  belonging  to 
u>2  are  separated  from  those  whose  status  are  indeterminate 
relative  to  Uj  and  u2 .  In  other  words,  the  nonfuzzy  section 
is  describe!  by 


*  »  +  l"l<W  X  £ 


x  w  +  "n.l<H)<  lwl<W  X  c  “2 


(3.5.15) 
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and  the  fuzzy  section  contains  samples  given  by 


|W|dmin  <  x  W  +  wn+1(H)  <  |w|d, 


max 


(3.5.16) 


These  fuzzy  samples  are  then  mapped  into  a  feature  space  fty 
by  the  following  transformation 


f  lXiTw  +  'WV' 


(3.5.17) 


and  the  process  is  continued  to  separate  the  fuzzy  section 
from  the  nonfuzzy  section  from  the  £2y  space  until  the  whole 
space  is  partitioned  into  two  regions. 

(3)  Multiclass  generalization. 


For  multiclass 


U) 


x  * 


i 

0. 


M 

2 


a 


the  classification 

| 

greater  than  dj (X) +M 

1 

to  decide  Xcw.  if 

i 

>0  and  d  (X)  +  |  < 

1 

Clearly,  fcom  multiclass  discriminant  functions  the 
learning  process  can  be  used  pairwise  by  using  Ho  and 
Kashyap's  procedure.  Ho  and  Kashyap's  algorithm  has  been 
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generalized  to  raulticlass  discriminant  functions  by  Wee 
(61) .  The  generalized  algorithm  has  the  advantage  of 
requiring  less  computation  than  pairwise  learning. 

3.5.3  Fuzzy  Automaton  as  a  model  of  Analog  Fault  Isolation 

Typically,  available  information  at  the  early  stage  of 
FA,  which  can  be  represented  using  the  fuzzy  set  idea,  is 
given  by  the  form  of  fuzzy  membership  function.  The  values 
of  the  fuzzy  membership  function  might  be  subjective  and 
local.  Assuming  those  initial  values  are  the  best  educated 
guess,  we  proceed  to  update  fuzzy  membership  values  through 
the  fuzzy  relations  and/or  various  reinforcement  schemes. 
The  fuzzy  relations  and/or  various  reinforcement  schemes  act 
as  training  operators. 

It  is  known  that  most  of  the  existing  diagnostic 
methods  are  sensitive  to  the  presence  of  even  minor  drift  in 
the  nonfaulty  components.  A  diagnostic  scheme  can  learn  to 
improve  classification  accuracy  of  observed  input  samples, 
if  the  weights  in  a  set  of  discriminant  functions  can  be 
adjusted  according  to  the  preselected  criteria.  For 
example,  a  criterion  based  on  sample  averages  and  the 
average  deviations,  when  a  set  of  test  samples  is  available. 
These  sets  of  weights  which  we  call  the  reference  vectors 
depend  on  the  choice  of  the  thresholds. 


A  basic  learning  model  for  fault  diagnosis  is  shown  in 
Fig.  3.5.  During  each  time  interval,  the  fault  diagnoser 


Test  Inputs 
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Fig. 3.6  Flow  diagram  for  a  learning  diagnostic  scheme  in  fault  testing. 
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jo 


receives  a  new  quantized  sample  X  from  the  faulty  system 
’with  drift  and  noise.  Quantized  X  is  fed  to  both  fault 
diagnoser  for  classification  and  performance  evaluator  or 
teacher  for  performance  evaluation.  Teacher  then  directs 
the  learning  of  the  diagnoser  using  a  linear  reinforcement 
scheme.  The  learned  information  is  considered  as  an 
experience  of  the  fault  pattern  classifier  and  experience 
will  be  used  to  improved  the  quality  of  the  diagnosis 
whenever  similar  situations  recur.  The  new  information 
extracted  from  recurring  pattern  is  used  to  update  the 
estimation  or  the  experience  associated  with  that  fault 
pattern. 

Fig.  3.6  shows  a  flow  diagram  for  a  proposed  learning 
diagnosis  scheme  (12).  In  this  scheme  it  is  assumed  that 
the  classifier  has  at  its  disposal  a  set  of  discriminant 
functions  characterized  by  a  set  of  parameters  such  as  the 
threshold  levels.  When  there  are  m  differnt  fault  classes, 
each  class  has  £,  learning  samples,  the  jth  sample  of  ith 
class  can  be  represented  by  vector  X^  in  the  signal  space 
of  n  dimensions  providing  that  signal  has  n  components.  The 
samples  may  represent  gain  and  phase  deviations  or  impulse 
deviations.  When  the  sets  of  discrimination  functions 
characterized  by  sets  of  parameters  such  as  thresholds  of 
quantizations,  selected  frequencies  or  time  delays  are 
presented  to  a  fuzzy  automaton,  the  system  adapts  itself  to 
the  best  solution.  The  best  solution  denotes  the  set  of 


w, 
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discriminant  functions  that  gives  the  maximum  recognition 
among  the  sets  of  discriminant  functions  within  the  set  of 
test  samples.  Clearly  the  best  set  of  discriminant 
functions  contains  the  best  set  of  parameter  values  for  the 
generation  of  test  programs. 

Quantization  of  test  samples,  deviation  measurements 
are  as  follows:  If  each  component  is  to  be  quantized  into 
three  levels,  say,  zero,  one,  minus  one  according  to  a 
preassigned  threshold,  then  X^j  is  represented  by 

Xfj  a  (x^  ,  t  •  •  •  i  ) i. j  (3.5.18) 


which  is  a  row  vector  of  n  random  variables  which  assume  the 
value  of  zero  oi  one  or  minus  one.  A  set  of  fault  reference 
vectors  is  obtained  by  the  sample  averages  of  the  training 
set,  i.e. 


Rr  «  (Rx  ,  It,  ,  . . . ,  R^  ) 


m 

T. 

i  =  ,l 


X .  . 
1 1 


(3.5.19) 


(3.5.20) 


The  correlatior  coefficient  between  and  each  of  the 

fault  references  are  determined  to  form  a  correlation  vector 

T 


The  rules  for  deciding  in  which  fault  type  in  an  unknown 
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pattern  should  be  classified  are 
if  XTRi  >  XTRk  all  k  *  j 

and  jx-R^jid..,  where  d^  «  a  positive  number,  then  the  jth 
fault  type  is  selected. 

The  diagnosis  phase  begins  by  applying  a  pattern  of  unknown 
fault  type  to  the  correlator  so  as  to  determine  its 
correlation  coefficient  with  respect  to  all  references. 
Once  decision  is  made,  its  corresponding  type  mean  is 
modified  so  that  the  reference  is  updated.  This  operation 
has  the  advantage  that,  on  the  average,  the  diagnostic 
performance  is  also  improved  during  the  recognition  phase. 
Consider  the  flew  chart  shown  in  figure  3.5  wherein  sets  of 
discriminant  functions  characterized  by  sets  of  parameters. 

In  particular  the  threshold  of  quantization,  and 
selected  frequencies  or  time  delays  are  presented  to  a  fuzzy 
automata  for  learning  the  best  sot.  This  implies  the 
minimum  mi srecognition  within  the  set  of  test  samples. 
These  sets  of  discriminant  functions  can  well  be  the  sample 
mean  of  fault  references  associated  with  the  correlation 
process  for  decision  making.  Instead  of  sample  mean 
references,  one  nay  employ  Towill's  voting  techniques  (3,5) 
which  are  heuristic  rules  and  have  been  shown  by  actual 
problem  simulation  to  be  superior  to  the  template-matching 
method.  It  suould  be  clear  that  the  best  set  of 
discriminant  functions  selected  by  the  automaton  contains 


the  best  set 
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of  parameter  values  necessary  for  the 
generation  of  a  test  program. 

3.5.4  A  Systematic  Learning  Procedure 

This  discussion  is  based  on  section  3.5.5.  This 
procedure  isolates  the  faulty  components  and  obtains  the 
optimum  threshold  by  our  learning  method. 

1.  We  start  with  a  given  active  circuit  description  having 
one  input  port  and  one  output  port.  The  input  is  one 
Volt  AC  at  different  frequencies. 

2.  We  are  given  the  14  following  postulated  fault 
conditions: 

R^  -k  2  <  R^  ,  R^  -►  2  x  R^  ,  -►  2  *  , 

R1  ->  R1/2,  ^  -  1*2 /2 *  R3  -  R3/2, 

C1  -  2<C1'  C2  *  C1  ’  V2' 

Gj  -  r^/10,  G2  -  G2/10. 

3.  We  assume  that  each  nonfaultv  component  is  varied 
under  3%  normal  distribution  to  simulate  component 
drift.  Also  the  output  measurement  noise  with  1% 
normal  distribution  added. 

4.  Frequency  domain  analysis  is  based  on  16  specified 
frequencies  at  which  14  gain  deviation  measurements 
and  11  phase  measurements.  In  sum,  we  are  usirg  25 
frequency  measurements. 

5.  We  assume  that  the  amplifier  of  the  active  circuit 


«4  - 

»4  •  *4/2. 
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has  one  pole  lowpass  filter  characteristics  with 
gain  cf  5*10  and  role  off  frequency  at  10  Hz. 
The  slope  is  -20dB/decade ,  and  modeled  by  the 
following  transfer  function. 


6.  The  transfer  function  ^/e^  is  given  by 


(3.5.21) 


Zf  (s) 


2.  (s) 


i  zf  fi7 

i  +  _(  i  ^  277s T~) 


(3.5.22) 


7,  We  denote  the  two  stages  of  the  circuit  as  A^  ,  A^ 
and  substitute  into  Eq.  3.5.22.  This  yields  two 
transfer  functions  e7/e^,  and  c^/e2  obtained  similarly, 
When  we  multiply  these  two  functions  together,  we  will 
get  the  overall  transfer  function.  This  transfer 
function  is  a  function  of  component  values  and 
frequencies. 


8.  We  defined  the  14  fault  patterns  according  to  the  14 
fault  conditions  (given  in  the  step  2)  with  component 
drifts  and  measurement  noise.  (u^  ,  ,  ..., 


ui4> 
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represents  14  fault  types. 

9.  For  computational  efficiency  as  well  as  convenience 
we  use  the  quantized  values  {1,  0,  -1)  of  deviation 
measurements  to  form  a  fault  recognition  matrix 

(  ).  An  element  R.  .  of  ith  column  and  jth  row 

1  J  1  j 

of  recognition  matrix  is  the  quantized  value 
(1,  0,  -1)  of  ith  fault  type  and  jth  frequency 
measurement  where  i  =  1,  2,...,  14,  j  =  1,  2,...,  25. 

10.  We  arbitrarily  assume  one  of  7  thresholds  to  quantize 
the  total  range  of  deviation  measurements. 

11.  For  each  specific  threshold,  there  corresponds 
one  fault  recognition  matrix. 

12.  The  choice  of  a  specific  threshold  is  made  based 
on  the  fuzzy  automaton  model.  For  our  illustrative 
example  the  input  to  the  fuzzy  automaton  is  either 

i 1,  0)  depending  on  the  success  or  failure  of  the 
diagnosis.  In  general,  we  can  use  the  fuzzy 
relations  studied  in  section  3.3  to  select  the 
other  threshold. 

13.  The  computer  model  of  the  system  is  used  to 
generate  the  simulated  faults  as  follows: 

a)  One  fault  condition  is  picked  from  among  the 
14  fault  conditions  randomly,  and  then  all  the 
other  component  values  are  picked  ramdomly 
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within  the  prescribed  tolerance  limit. 

b)  Generate  output  responses  at  the  selected 

frequencies  using  the  computer  simulations 
(25  measurements).  Add  random  noise  to  the 
measurements  (given  in  step  3)  . 

c)  Calculate  the  deviation  measurements. 

d)  Calculate  the  quantization  deviation  vector, 

X  -  (  > , . . . ,  Xj  , . . . ,  X25  )  corresponding  to 
the  threshold  selected  in  step  12.  Where  X. 
represents  the  quantized  value  of  incoming  jth 
deviation  frequency  measurement. 


14.  Fault  Recognition  Matrix 

Once  a  specific  threshold  is  chosen,  we  produce  the 
corresponding  recognition  matrix  (R^ ^  ) . 


15.  A  classification  rule  for  fault  isolation  is  a 
minimum  distance  criterion.  Thus  the  ith  pattern 
yielding 


25 

min  ) 

i  J 


is  chosen. 


16.  Above  choice  is  compared  with  the  choice  of  teacher, 
and  the  decision  as  to  the  correctness  of  the 
classification  for  updating  the  membership  values 
of  given  thresholds  in  the  step  18. 


17.  We  assign  an  initial  fuzzy  membership  value  to 


eav  a  c  given  thresholds.  This  value  indicates  the 
degree  of  correctness  or  the  percentage  of  the 
diagnosis  based  on  the  selected  threshold.  The 
thresholds  and  the  corresponding  membership  values 
are  represented  as 

{  (T^  ,  fx ) ,  <Th2  ,  f2  ) ,  . . . ,  (Th?  ,  f? ) } . 


The  membership  value  to  be  assigned  for  a 
threshold  is  learned  from  the  information  as  to  the 
correctness  of  the  fault  isolation  decision  of  an 
incoming  set  of  measurements  in  step  16, 

The  learning  scheme  used  is  known  as  the  linear 
reinforcement  scheme. 


fi(n+l)  »af.  (n)  +  (l-u)<j>(X,  u..) 


f  (n+1)  *af.(n)  +  (1-a)  (1-XX,  u.)) 

J  J  ■*" 


(3.5.23) 


where  0  <  a  <  1,  ( X , w ^ )  = 


1  if  x  f  u. 


0  if  X  t  ui. 

1 


These  learned  fuzzy  membership  values  will  affect 
the  choice  of  the  next  threshold  in  step  12. 

If  the  maximum  fuzzy  membership  value  achieved 
based  on  the  seven  thresholds  meets  the  design 
requirements,  then  3top  the  learning  process  and 
use  this  particular  threshold. 


If  not,  we  select  another  set  of  thresholds  close 
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to  the  one  which  achieved  the  maximum  membership 
value.  Then  repeat  the  procedure  starting  at  step 
10. 

21.  Implementation  of  this  fault  isolation  procedure 
is  relatively  simple  and  straightforward  since 
in  the  field  we  only  use  the  selected  optimum 
threshold. 

3.5.5  Illustrative  example  using  an  Active  Linear  Network 

We  start  i*ith  a  given  active  circuit  in  Figure  3.7 
having  one  input  port  and  one  output  port.  The  input  is  1 
Volt  AC  at  different  frequencies.  Frequency  domain  analysis 
based  on  16  specified  frequencies  ranging  from  10  rad/sec  to 

7 

10  rad/sec  at  which  14  gain  deviation  measurements  and  11 
phase  measurements.  In  sum,  we  are  using  25  frequency 
measurements . 


Fig.  3.7  Circuit  Diagram 
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Figure  3.7  represents  the  functional  model  of  a  simple 
analog  circuit  consisting  of  four  resistors,  two  capacitors 
and  two  operational  amplifiers  which  are  treated  as 
functional  models.  Postulated  fault  conditions  are  at  step 
2  of  section  3.5.4. 


Fig,  3.8  Amplifier  Characteristic 


Figure  3.8  shows  the  characteristics  of  the  two 
identical  op.  amps.  The  functional  model  of  these  op. 
amps,  can  be  approximated  as 


Ai 


M 


1  +  62.8 


G, 


A  2  «r 


1  + 


62.8 


Table  3.1  Nominal  Values  and  Analytical  Expressions 
fnr  Linear  Circuit 


R1 

=  1,000 

R3 

a 

10,000 

R2 

=  10,000 

R4 

10,000 

C1 

■  1.6  x  10'  9 

C2 

a 

1.6  x  10' 

G1 

»  2  /  10:> 

G2 

o 

rH 

< 

CM 

Table  3.1  lists  the  nominal  values  of  the  elements 
together  with  the  analytic  expression  of  the  transfer 
function.  This  circuit  has  previously  been  studied  for 
fault  diagnosis  based  on  the  choice  of  transfer  function 
parameters  as  a  fault  signature  (33).  Herein  we  use  gain 
and  phase  deviations  between  faulty  and  nominal  response  at 
a  set  of  select  3d  frequencies  to  isolate  a  single  fault  in 
the  system  under  test.  The  nonfaulty  components  are  assumed 
to  have  3%  tolerance  while  the  measurements  are  contaminated 
by  1%  noise.  The  Bode  plot  of  the  nominal  gain  response  as 

shown  in  figure  3.9  has  break  away  frequencies  at  625 

4  6  7 

rad/sec,  5.95x10  rad/sec,  6,28x10  rad/sec  and  1.319x10 

rad/sec. 


gain  | 
dB  i 
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According  to  Sriyananda,  Towill,  and  Williams  (5) 

experience  suggests  that  the  number  of  selected  measurements 

should  be  approximately  three  times  the  number  of  fault 

cases  if  all  gain  and  phase  data  are  useful.  They  also 

pointed  out  that  the  threshold  for  quantization  of  the 

deviations  is  a  major  influencing  factor  for  the  generation 

of  the  best  set  of  features  in  analog  testing.  16 

7 

frequencies,  ranging  from  10  rad/sec  to  10  rad/sec,  are 
selected.  Six  frequencies  have  both  gain  and  phase 
measurements.  Altogether  there  are  14  phase  measurements 
and  11  gain  measurements.  Seven  quantization  thresholds  are 
chosen  to  generate  seven  sets  of  fault  reference  vectors. 
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Thresholds 
Solution  level 


60  120  180  240  300 

Number  of  learning  iterations 


Fig.  3.10  Learning  Curves  for  Sets  of  Discriminant 
Functions 

Figure  3.10  snows  the  learning  curves  of  the  membership 
functions  versus  the  number  of  training  samples  for  the  14 
types  of  faults  in  a  computer  simulation  study  using  Eq. 
3.5.23.  Even  though  the  number  of  training  samples  is  not 
large  the  trend  is  already  evident.  The  value  0.05  is  the 
best  among  the  set  chosen,  and  fuzzy  membership  function 
approaches  ).85. 


Fig.  3.11  Learning  Curves  for  Refined  Sets  of 
Discriminant  Functions 


Figure  3.11  illustrates  several  thresholds  in  the 
neighborhood  of  0.05,  0.06  has  the  highest  grade  of 
membership  which  is  0.9.  When  the  selected  frequencies  are 
chosen  from  10  rad/sec  to  10  rad/sec  and  a  single  fault  is 
isolated  to  a  group  of  components  such  as  R1»R2  and 
Ci  'U]  'U2  '  1-earn^r‘<3  curves  are  shown  in  figure  3.12  and 
figure  3.13.  Note  that  the  set  of  reference  vectors  with 
0.1  threshold  attains  the  grade  of  membership  of  0.94. 


The  ne  <t  simulation  studies  involve  comparisons  between 
learning  with  fuzzy  automaton  model  and  learning  with  fuzzy 


Wf 


80  120  160  200  240  280  320  360  400 

Number  of  Learning  •-er at ions 
Membership  functions  vs  k  using  distance  measure 
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automaton  model  using  sample  mean  references  while  changing 
component  drift  and  measurement  noise.  Assumputions  are  the 
same  as  in  the  previous  example,  except  that  17  frequencies 
are  selected  in  the  same  ranges.  Eight  frequencies  have 
both  gain  and  phase  measurements.  Seven  quantization 
thresholds  are  chosen  to  generate  7  sets  of  fault  references 
vectors.  Figure  .7.14  shows  the  learning  curves  of 
membership  functions  against  the  number  of  training  samples 
for  the  8  types  of  single  faults  in  a  computer  simulation 
study.  In  this  figure  we  assume  that  the  component  drift  is 
3%  while  the  measurement  noise  is  3%.  The  reference  vectors 
used  in  this  case  are  from  the  deviations  when  the  non faulty 
components  are  at  their  nominal  values  and  the  measurements 
are  noise  free.  Although  the  number  of  training  samples  is 
not  large  the  trend  is  again  evident.  The  quantizing  level 
0.25  is  the  beat  among  those  chosen,  and  fuzzy  membership 
approaches  0.9.  Figure  3.15  shows  the  learning  curves  of 
the  membership  functions  against  the  number  of  training 
samples  with  mean  reference  vectors.  During  learning,  the 
mean  reference  vector  is  updated.  This  has  the  advantage 
that  on  the  average,  diagnostic  performance  is  also  improved 
even  during  the  recognition  phase.  It  turns  out  that  a 
quantization  level  of  0.25  is  again  the  best  among  the  given 
set.  Here  the  fuzzy  membership  function  increases  from  0.9 
to  0.94,  f igure  3.16  shows  the  case  when  component  drift 
and  measurement  noise  both  increase  to  101.  The  reference 
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vectors  used  in  this  simulation  are  the  same  ones  used  in 
Figure  3.13.  In  this  case  0.15  level  turned  to  be  the  best 
and  the  highest  membership  function  is  only  0.67.  Level 
0.25  is  in  third  place. 

Instead  of  using  the  given  reference  vectors,  we  can 
also  use  the  mean  reference  vectors.  The  adjusting  rule  is: 

R.  .  (n+1)  =  —  R.  .  (n)  +  -  X.  (n)*i|>(n) 

13  n  13  n  3 

wherein)  =11  if  X  is  correctly  classified 

l  -1  if  X  is  not  correctly  classified. 

One  of  the  advantages  of  this  is  to  increase  the 
percentage  of  correct  fault  diagnosis.  A  significant 
drawback  i3  that  one  must  revert  to  making  analog 
measurements  instead  of  the  simple  1,  0,  and  -1  indicated  in 

the  procedure  of  sec.  3.5.4.  Figure  3.17  has  the  same 
condition  as  Figure  3.16  except  that  we  used  the  mean 
reference  vectors.  The  best  quantization  threshold  turns 
out  to  be  the  same  as  for  figure  3.16  but  the  membership 
value  at  that  threshold  increases  to  0.725.  This  is  about 
5%  higher  than  in  the  previous  case.  Instead  of  the  sample 
mean  reference,  one  may  use  Towill's  voting  techniques. 
These  are  heuristic  rules  that  have  been  shown  by  actual 
problem  simulation  to  be  superior  to  all  existing  template 
matching  methods.  Table  3.2  shows  a  comparison  of  the 
distance  criteria  and  voting  tecniques.  We  specifically  use 


Number  of  Learning  iterations  k 
Fig.  3.16  Membership  function  vs.  k  using  distance  measure 


measurement  noise 


uantization  0.00  0.05  0.1  0.15  0.2  0.25  0.3 


Table  3.2  Comparison  of  Different 


the  seven  thresholds  (0,  0.05,  0.1,  0.15,  0.20,  0.25,  0.30) 
dB.  The  four  cases  of  tolerance  and  measurement  noise  are 
3%,  5%,  8%,  and  10%  within  the  normal  distributions.  We 
compared  voting  technique,  voting  technique  with  mean 
reference  vector  adjustment,  distance  criterion,  and 
distance  criterion  with  mean  reference  vector.  For  small 
tolerances  of  nonfaulty  components  and  measurement  noise 
such  as  the  3%  case,  they  perform  equally  well.  As 
tolerance  and  measurement  noise  increase  to  10%  the  distance 
criteria  appears  to  be  somewhat  more  effective.  Although  we 
have  only  used  a  preselected  set  of  frequencies,  we  can  also 
"learn"  the  best  set  from  a  given  set  of  frequency 
measurements. 

3.5.6  Discussion 

Our  objective  is  to  select  a  specific  threshold  so  as 
to  permit  simple  implementation  of  ATE  for  easy  field  use. 
For  analog  electronic  systems  with  drift  and  noise,  the 
measured  set  of  responses  for  different  fault  types  often 
exhibits  highly  overlapping  patterns.  Depending  on  the 
choice  of  a  specific  threshold  from  among  the  seven 
thresholds,  we  can  discriminate  the  best  among  the  fault 
patterns.  Since  the  assumed  test  frequencies  are  fixed,  the 
method  of  choosing  the  specific  threshold  is  the  most 
important  factor  determining  the  optimum  achievable 
discrimination.  The  concept  of  fuzziness  is  involved 
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because  one  tries  to  determine  how  effective  a  discriminant 
function  is  obtained  by  use  of  a  specific  threshold.  The 
application  of  learning  techniques  to  reduce  the  degree  of 
fuzziness  has  been  presented.  We  emphasize  the  importance 
of  selection  of  features  to  be  measured  in  analog  testing  to 
achieve  effective  fault  diagnosis. 

Herein  we  have  demonstrated  that  a  fuzzy  automaton 
learning  model  can  be  applied  to  select  an  optimal  set  of 
such  features. 


I 

\ 
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3.6  Fault  Isolation  Method  using  the  Fuzzy  Logic 

For  nonlinear  analog  circuits  subject  to  drift  and 
noise,  the  resulting  measurement  patterns  of  faults  are  in 
general  fuzzy  so  that  ad  hoc  specification  of  fault 
isolation  tests  is  inadequate.  Considered  in  the  context:  of 
fuzzy  systems,  fault  pattern  types  are  first  separated  into 
non-fuzzy  and  fuzzy  parts  corresponding  to  non-overlapping 
and  overlapping  regions  obtained  by  sensitivity  analysis. 
The  grade  of  membership  of  the  fuzzy  parts  are  then  modified 
according  to  simulation  results  and  the  decision  based  on 
fuzzy  relations  (35) .  Thus,  a  sequence  of  input-access 
point  responses  with  highest  membership  value  is  selected  as 
the  basis  for  generation  of  automatic  fault  isolation  tests. 

3.6.1  Introduction 

The  design  of  functional  and  fault  isolation  tests  is 
now  recognized  as  an  essential  task  needed  at  the  design  and 
quality-assurance  stages  of  analog  circuits  in  electronic 
systems.  Practical  analog  systems  are  subject  to  drift  and 
are  exposed  to  noise.  Furthermore  under  fault  conditions 
such  systems  in  general  become  nonlinear.  It  is  not 
suprising  therefore  that  the  design  of  an  automatic  fault 
isolation  test  based  on  a  deterministic  approach  fails  to 
give  satisfactory  results.  Therefore  the  measurement 
responses  yield  highly  overlapped  and  scattered  fault 
patterns  (<1,12).  The  statistical  approach  also  fails 
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whenever  it  is  impossible  to  represent  highly  overlapped  and 
scattered  fault  patterns  by  known  distribution  functions. 
The  statistical  approach  will  also  fail  when  there  is  no  a 
priori  information  available.  Then  one  can  not  expect  the 
distribution  of  fault  patterns  to  correspond  precisely  to  an 
assumed  distribution.  Furthermore,  it  is  often  unreasonable 
to  make  the  convenient  statistical  independence  assumption 
for  the  components  of  fault  pattern  vectors.  For  systems 
with  realistic  component  tolerances  and  noisy  environment, 
therefore,  we  consider  fault  isolation  is  essentially  fuzzy. 
Our  approach  uses  the  fuzzy  concept  to  develop  a  systematic 
way  of  generating  automatic  fault  isolation  tests  for 
practical  circuits  (49).  The  procedure  for  the  design  of 
automatic  fault  isolation  tests  is  shown  in  Fig.  3.18.  The 
essential  steps  are 

(1)  Simulation  of  responses  at  available  access 

points  of  a  unit  under  test  (UUT)  by  means 
of  computer  aided  network  analysis  program 
for  a  set  of  prespecified  fault  conditions. 

(2)  Estimation  of  the  upper  and  lower  bounds  of 

fault  pattern  types  by  means  of  sensitivity 
analysis . 

(3)  Modification  of  the  grade  membership  of  the 

fault  pattern  belonging  to  certain  fault 
type  using  fuzzy  relations  on  a  set  of 
training  samples  assuming  a  specified  distri- 


Fig.  3.18  A  Design  Procedure  for  Automatic  Fault  Isolation  Tests 
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bution  of  the  nonfaulty  component  tolerances. 

(4)  Selection  of  tests  yielding  the  highest  grade 
of  membership  functions  for  the  discrimination 
among  fault  pattern  types. 

3.6.2  Fault  Response  Simulation 

Instead  of  physically  changing  a  component  or  module  to 
introduce  a  specific  fault  in  hardware,  it  is  much  more 
convenient  to  use  a  computer  aided  network  analysis  (CANA) 
program.  For  example,  a  library  containing  transistors  and 
diodes  may  be  found  in  a  model  library  on  the  extended 
SCEPTRE  (89)  program  tape.  A  CANA  program  uses  the 
topological  description  and  the  component  values  of  a 
circuit  to  formulate  network  equations  which  are  then  solved 
by  numerical  methods.  To  perform  a  fault  isolation  test 
simulation,  the  required  information  includes  (1)  the 
topological  description,  the  nominal  values  of  the 
components  and  their  tolerances,  (2)  the  description  of  the 
input  and  accessible  test  points,  (3)  the  definition  of  the 
failure  modes.  In  a  nonlinear  network  analysis  program  for 
lumped  circuits,  the  response  calculation  is  based  on  the 
formulation  of  network  equations  and  sparse  matrix 
technique.  For  nonlinear  circuits  the  Newton-  Raphson 
method  is  used.  From  the  standpoint  of  cost  effectiveness 
it  is  advisable  to  model  each  integrated  circuit  type  as  a 
functional  element  because  many  internal  failures  of  the 
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integrated  circuit  package  are  indistinguishable  at  the 
external  terminals.  In  a  computer  aided  test  design  system 
it  is  desirable  to  reduce  the  amount  of  calculations  for 
setting  up  a  test  program  which  leads  to  an  acceptable 
degree  of  fault  diagnosis.  A  simple  fault  isolation 
technique  using  binary  logical  conjunction  of  failure 
response  regions  has  the  advantage  of  reducing  the  amount  of 
calculation  but  often  fails  to  achieve  an  acceptable 
diagnostic  level  (7).  Fuzzy  set  theory  seems  able  to 
overcome  some  of  these  difficulties. 


3.6.3  Response  Sensitivity  With  Respect  To  Tolerances 


To  determine  the  upper  and  lower  bounds  of  the  response 
at  an  accessible  point  for  a  specified  failure  mode  while 
nonfaulty  components  have  reasonable  tolerances  would 
require  a  large  amount  of  simulation  work.  To  reduce  the 
effort,  one  can  use  a  sensitivity  analysis  to  estimate  the 
approximate  bounds  as  follows.  Let  AC^  be  the  maximum  per 
unit  tolerance  of  non- faulty  component  .  The  response 
sensitivities  with  respect  to  n  non-faulty  component  at  an 
access  point  are  3P  ,  i  *  !,••••  ,n,  where  P  is  the 


3Cio 

response  and  the  0^o  is  the  nominal  value  of  C^.  As  a  first 
approximation  we  may  compute  the  upper  and  lower  bound 
according  to  the  sign  of  3p  .  If  3p  is  positive  for  i  * 
l,*-*»,  m  and  is  negative  for  j  =  m+1,*-**,  n,  then 
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(3.6.2) 


where  P  is  the  fault  response  when  the  non-faultv 

O 

components  have  their  nominal  values.  To  take  into  account 
a  nonlinear  effect,  one  normally  would  have  to  compute 
second  and  higher  order  sensitivities  and  calculation 
becomes  laborious.  A  simple  way  to  include  nonlinear 
effects  is  to  use  the  deviations  6{C*  and  6-C.:  from  Eq's 
(3.6.1)  and  (3.6.2)  as  the  worst  case  to  compute  directly 
the  response  by  means  of  CANA  program  (69) .  In  practical 
cases  this  simple  method  gives  the  uppex  and  lower  bounds 
quite  close  to  results  obtained  by  extensive  simulation.  In 
some  cases  where  the  domminant  variation  of  the  response 
with  respect  to  some  components  is  quadratic,  the  simple 
method  is  not  satisfactory.  However,  this  can  be  remedied 

by  using  Max  (P  ,  2P^  -  P  .  )  and  Min  (P  .  ,  2P  -  P  ) 

max  0  mm  mm  max  o 

as  the  upper  and  lower  bound,  respectively. 

3.6.4  Fault  Isolation  Using  the  Fuzzy  Logic 

The  essential  task  of  fault  isolation  in  a  fuzzy 
environment  is  to  recognize  the  membership  of  responses 
which  belongs  to  a  designated  fault  class  and  to  distinguish 
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among  memberships  which  belong  to  different  fault  classes. 
This  can  be  conveniently  established  around  the  notion  of 
the  "belonging"  in  the  case  of  fuzzy  sets  if  the  boundaries 
between  fault  pattern  classes  are  not  sharply  defined.  Let 
u>  ,  u>  ,  . ..,  to  fuzzy  fault  pattern  classes  in  the  fault 
response  space  P,  and  p  be  the  generating  element  of  P.  We 
define  fwi(p)  at  p  to  be  the  grade  of  membership  p  in  to1  and 
fui(p)  associates  each  point  p  with  a  real  number  in  the 
interval  (0,1).  When  to1  is  a  set  in  the  ordinary  sense  of 
the  terra,  then  its  membership  function  can  take  only  one  and 
zero  according  as  p  does  or  does  not  belong  to  to1 . 

Suppose  the  upper  and  lower  bounds  of  the  responses  at 
available  access  points  for  a  set  of  specified  fault  condi¬ 
tions  have  been  estimated  by  the  sensitivity  analysis.  The 
regions  between  these  bounds  may  or  may  not  overlap.  The 
non-overlapping  regions,  wherein  fault  isolation  becomes 
very  simple,  are  easily  distinguished  from  the  fuzzy 
regions.  Using  binary  logic  some  fault  can  also  be  isolated 
from  the  overlapping  regions. 

The  grade  of  fuzzy  membership  for  a  particular  fault 
condition  when  a  response  lies  in  a  certain  region  may  be 
assessed  according  to  some  a  priori  information.  As  an 
example  Fig.  3.19  shows  the  response  regions  of  5  single 
faults  measured  at  access  points  k,  k=l,2,3.  Let  .  be  the 

K  J 

response  due  to  the  ith  fault  measured  at  access  point  k 
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that  falls  in  the  region  R^ ,  j»l,2,...,  5,.  and  k=l,2,3. 

Initially  we  assign  the  membership  value  of  .  as  one  only 
if  i»j.  Notice  that  because  of  overlapping  regions,  the 
response  of  a  fault  other  than  the  ith  one  may  also  fall  in 
the  region  R., .  To  estimate  the  grade  of  membership  for  the 
case  that  only  the  response  of  ith  fault  falls  in  the  region 
Rj,  and  no  other  response  can  appear  in  the  same  region.  To 
do  this  we  use  a  set  of  additional  samples  for  estimating 
the  membership  functions  of  the  related  faults  in  the 
overlapping  regions  together  with  fuzzy  relations.  The 
membership  of  the  overlapping  regions  are  shown  in  Table 

3.3,  in  which  f  „.i  represents  the  grade  membership  of  ith 

k  j 

fault  response  at  kth  access  point  in  jth  overlapping  region 
or  simply  jth  region. 


(1)  Fuzzy  Relations 


The  commonly  used  modes  of  composition  of  two  fuzzy 
relations  are  (a)  conjunctive,  involving  the  connective 
"and",  (b) ,  disjunctive,  involving  the  connective  "or".  The 
membership  function  of  the  union  of  two  fuzzy  sets  with 
respective  membership  functions  fA (p) ,  fg (p)  is 

fAUB(p)  =  MaX  (  fA(p)'  fB(p))'  P  £  P  (3.6.3) 


The  i.icmbership  function  of  the  intersection  of  the 
above  two  fuzzy  sets  is  given  by 
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fAflB  =  min  (  fA(p)'  fB(p))/  P  e  P  (3.6.4) 

In  the  case  of  binary  fuzzy  relations  the  composition 
of  two  fuzzy  relations  A  and  B  is  denoted  by  Bo A,  and  is 
defined  as  a  fuzzy  relation  in  P  whose  membership  function 
is  related  to  those  of  A  and  B  by 

fBoA(p'q)  “  Sup  min  (  fA(p,v),  fQ(v,q)).  (3.6.5) 

(2)  Membership  Function  of  Refined  Sets 

het  be  the  response  of  the  ith  fault  measured  at 

access  point  k  that  falls  in  the  region  under  the 

condition  that  no  other  fault  response  appears  in  R^ .  We 
call  a  refined  set  of  .  To  estimate  the  membership 

function  f  ,  it  is  convenient  to  use  the  composition  of 

k  i 

fuzzy  relations  similar  to  Eq.  (3.6.5)  as  follows: 

I 

fa  Sup  min  (  f  i ,  f  ,v  )  (3.6.6) 

kwi  y  k^v  kw  i 

where  denotes  the  complement.  It  may  be  noted  that 
"conjunctive"  and  "disjunctive"  modes  in  Eq.  (3.6.6)  also 
appears  in  Zadeh's  possibility  theory.  Table  3.4  shows  the 

values  of  f  calculated  by  Eq.  (3.6.6)  using  the  values 

k  i 

given  in  Table  3.3,  From  Table  3.4,  the  overlapped  regions 
can  b®  e\iminated  by  a  pairwise  comparison  among  the  values 
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A  Partial  Overlapped  Response  with 
Fuzzy  Membership 
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of  f  (  .  The  modified  non-overlapped  regions  are  also 

kio  • 

1 

shown.  Further,  the  value  of  k  that  yields  the  highest 

value  of  f  ,  k=l,2,3  is  chosen  as  the  input  for  ATPG. 

k  i 

3.6.5  Fault  Isolation  Procedure 

1.  We  start  with  a  given  circuit  description  having  10 
input  ports,  10  output  ports,  and  72  components. 

2.  DC  measurements  at  selected  ports  are  used. 

3.  We  generate  upper  and  lower  bound  of  the  responses 
for  each  fault  pattern  using  senitivity  analysis 
of  NAP 2  Nonlinear  Analysis  Program. 

4.  Fuzzy  membership  for  each  interval  is  given  as 

The  length  of  ith  nonoverlapping  interval 
The  length  of total  interval 

The  implication  is  that  if  entire  region  is 
nonoverlapped  then  membership  equals  to  one  and  if 
entire  region  is  overlapped  then  membership  equals 
to  zero. 

5.  Whenever  there  is  a  simulated  test  sample,  we  assign 
the  fuzzy  membership  values  according  to  the  step  4. 

6.  We  use  the  fuzzy  selection  logic  to  diagnose  the 
fault  using  Eq.  3.6.6. 

7.  If  the  fuzzy  membership  value  of  the  selected  fault 
is  above  certain  value  a  (0  <  a  <  1) ,  then  use 
the  selected  measurements.  If  the  fuzzy  membership 
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value  of  the  selected  fault  is  below  certain  value  a  , 
we  need  additional  access  points  to  generate  response 
measurements . 

8.  If  fault  isolation  is  acceptable,  then  use  the  set  of 
fuzzy  membership  values  for  future  fault  isolation. 
Otherwise  add  the  access  points  and  increase  the 

m  •  j«i  v»  ^  £  m  as  ^ 

muiwci  \j x.  mcoouicmcuuo  » 

3.6.6  An  Illustrative  Example 

Figure  3.20  is  a  diagram  of  a  communication  I/O  circuit 
board  having  40  resistors,  10  diodes,  3  capacitors,  18 
trnsistors,  one  operational  amplifier,  and  3  DC  power 

sources.  We  assume  38  single  fault  cases  including  33 
catastrophic  or  "hard"  failures  and  5  "soft"  fault  cases  in 
which  failure  component  has  twice  its  nominal  value.  The 
circuits  can  be  subdivided  into  3  line  .river  subcircuits,  4 
buffer  circuits,  line  receiver,  and  control  circuits.  In 
each  subcircuit,  one  input  point  and  one  output  access  point 
are  used.  DC  voltage  inputs  of  0  and  5  volts  are  used  and 
the  output  voltages  are  measured  at  all  access  points.  One 
output  current  is  measured  in  each  line  driver  subcircuit. 
The  tolerances  are  5%  for  the  resistors  and  1%  for  the 
forward  current  of  the  modeled  transistors. 

The  worst  case  analysis  of  NAP2  (85,86)  program 
provides  us  the  approximate  upper  and  lower  bounds  on  the 
given  simulated  responses.  These  upper  and  lower  bound  are 
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changed  by  using  Max  (P  ,  2P  -  P  .  ) ,  Min  (P  .  ,  2P 

max  o  mm  mm  max 

P  )  when  necessary.  Starting  with  38  fault  cases ,  27  fault 

o 

cases  are  isolated  using  binary  logic.  Using  fuzzy  logic, 
we  can  distinguish  four  more  failure  cases  for  about  10% 
improvement . 

Table  3.5  is  a  partial  list  of  the  overlapped  response 
regions  of  ith  fault  at  access  point  k  and  the  membership 
functions  computed  from  test  samples  with  the  method 
discussed  in  section  3.6.4.  From  fuzzy  membership 
calculations  with  a  preselected  threshold  0.7,  four  more 
test  regions  with  the  highest  fuzzy  memberships  are  added 
into  the  test  data.  A  partial  listing  of  the  input  to  the 
NOPAL  is  given  in  Fig.  3.6.4.  This  program  is  implemented 
in  FORTRAN  on  the  Moore  School  UNIVAC  90/70.  Most  of  the 
epu  time  was  consumed  to  simulate  the  fault  cases. 
Generation  of  the  worst  case  analysis  took  about  600  sec. 
epu  time  and  a  test  sample  simulation  took  about  1000  sec. 
epu  time. 

3.6.7  Discussions 

It  has  been  shown  that  the  application  of  the  fuzzy 
concept  together  with  the  worst  case  analysis  and  test 
samples  can  reduce  the  number  of  simulations  required  for 
the  design  of  fault  isolation  tests.  Only  single  faults 
using  DC  signals  were  considered.  The  method  presented 
herein  should  be  refined  in  order  to  extend  it  for  handling 
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multiple  faults  of  frequency  or  transient  data. 

3.7  Chapter  Summary 

The  situation  often  encountered  is  that  the  system  under 
consideration  has  very  little  information  available,  and  the 
formulation  of  an  optimal  control  or  recognition  policy 
needs  accumulation  of  this  information.  Learning  system  is 
defined  as  a  system  which  accumulates  the  information  for 
certain  improvements  of  the  system.  FA  model  we  described 
is  a  good  candidate  for  a  learning  system  under  fuzzy 
environments.  Fuzzy  environment  refers  to  the  unknown 
environment  which  tries  to  give  the  system  having  maximum 
vagueness  cr  indeterminacy.  As  we  discussesd  in  the  earlier 
chapter,  we  can  categorize  the  uncertainties  into  two 
different  engineering  discipline.  One  is  randomness  which 
can  be  handled  by  probability  theory  and  the  other  is 
indeterminacy  or  vagueness  which  can  be  handled  by  fuzzy  set 
theory.  We  are  mainly  concerned  the  case  when  indeterminacy 
and  vaguenss  are  the  major  portion  of  the  uncertainties.  We 
established  the  fuzzy  automaton  model  for  learning  systems. 
Properties  of  various  fuzzy  relations  were  explored. 

Two  analog  fault  isolation  algorithms  are  studied.  An 
active  lowpass  filter  and  a  communication  I/O  circuit  are 
used  as  exanples. 
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CHAPTER  4  Fuzzy  Distance  Measure  and  Fuzzy  Entropy  Measure 
in  Fault  Isolation 

4.1  Introduction 

Mathematical  modelling  is  typically  based  on  the  system 
which  is  developed  by  a  set  of  axioms.  An  important 
observation  is  that  the  logical  structure  of  a  fuzzy  set  is 
essentially  Boolean,  except  for  the  violation  of  the  law  of 
excluded  middle  and  the  violation  of  the  law  of 
contradiction  where  fuzziness  remains  (41).  Care  must  be 
taken  if  one  departs  from  an  axiomatic  system  or  tries  to 
use  several  axiomatic  systems  which  may  be  muatually 
inconsistent.  The  best  hope  one  can  have  is  that  each 
axiomatic  system  approximates  the  other  under  specified 
conditions.  Then  we  might  be  able  to  use  these  several 
axiomatic  systems  as  an  approximation  to  the  real  system. 

Aspects  of  fuzzy  set  theory  are  close  to  but  distinct 
from  that  of  probability  theory.  Consequently  the  concept 
of  a  valuation  differs  an  important  ways  from  that  of  an 
ordinary  measure.  Valuations  ot  a  fuzzy  set  may  be 
restricted  to  subsets  of  reference  space,  as  it  is  done  in 
measure  theory  using  the  notions  of  Borel  fields.  In 
effect,  valuations  are  defined  on  a  reference  space  which 
form  a  convenient  structure  for  use  with  the  given 
operation.  Such  an  approach  to  the  theory  of  fuzzy  subsets 
has  recently  been  described  in  a  highly  significant  work  by 
Sugeno  (51) . 


''  *  **$ 
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4.2  Fuzzy  Distance  Measure  (FDM) 

4.2.1  Definition 

It  has  been  pointed  out  recently  (43)  that  the 
important  terms  in  fuzzy  set  theory,  "equivalence", 
"implication"  can  be  expressed  through  the  definition  of 
metric  terms.  First  the  lattice  Lj ,  j  ■  l,...,m  is  defined 
on  each  measurement  space  with  "*"  fixed  points  which  are 
given  by  the  preset  conditions.  The  binary  operations  on 
the  fuzzy  set  are  defined  as  the  maximum  and  minimum  of  the 
two  operands.  A  metric  on  the  lattice  giving  a  measure  of 
the  "distance"  apart  of  two  propositions  under  a  valuation 
is  defined  as  follows:  (4.2.1) 


Vxlj'  x2j  e  Lj'  d(xij'  x2j)=  log*(  rank  order  (x2j  Ixj^) ). 


Thus  the  distance  of  the  two  measurements  are  defined  by 
the  logarithmic  value  of  the  rank  order  of  x2j  from  x^j. 
Distance  d  satisfies  a  quasimetric  on  Lj  such  that 


d(xlj'x2j)  =  0 
0  S  d(xlr.x2.)  s  1 

d(xij,x  )  +  d(x 


2j'V  *  d<xlj'x3j>  • 


(4.2.2) 

(4.2.3) 

(4.2.4) 


Proofs  of  eq.  (4.2.2)  and  (4.2.3)  are  an  immediate 
extension  of  the  definition.  Equation  (4.2.4)  can  be  proved 
as  follows: 


;,W'Wi  wssuwssBsra 
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where  n,  rc ,  k  is  the  associated  rank  order. 

n  <  t,  m  <  t,  k  <  n+m  <  i 

d(x,y)+d(y,z)-d(x,J!)  *  log^n  +  log^m  -  log^k  -  log^nm  -  log^fn+m) 
«  “Uog^"  +  l°g^~  )  >  0  .  qed. 


It  is  also  reasonable  to  define  a  measure  of  equivalence  as 
V  yjf  xL.  e  Ljt  u(yj  =  x^>  »  1  -  d(y.,  x..)  .  (4.2.5) 

4.2.2  FDM  as  a  Fault  Isolation  Criterion 


For  our  purposes  this  distance  criterion  assumes  that 
inserted  faults  lie  within  a  predetermined  deviation  of  the 
"typical"  single  faults.  With  this  in  mind  we  turn  to 
definition  of  a  fuzzy  distance  for  fault  measurements. 

We  define  a  measure  of  the  "distance"  or  apartness  of 
two  output  measurements  x^  and  x2j  as  follows, 


V  x 
d(x 


i  r 


X0.  e  L. 

23  3 

x2j)  =  log^(rank  order 


Xjjl) 


(4. 2.6) 


where  "4"  is  the  number  of  fault  classes. 

Then  the  problem  of  fault  isolation  can  be  interpreted 
as  the  need  to  find  the  minimum  distance  between  the 
measurement  of  UUT  Y  and  preset  values  x^’s,  where  the 
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x—  's  are  elements  of  a  typical  fault  pattern  vector  Xj ,  and 
where  subscript  i  stands  for  different  fault  types  and 
subscript  j  stands  for  number  of  measurements  to  be  made. 

4.3  Fuzzy  Entropy  Measure 

Kolmogorov  argued  that  the  basic  information  theory 
concept  must  and  can  be  found  without  recourse  to 
probability  theory  and  in  such  a  manner  that  "entropy"  and 
"mutual  information"  concepts  are  applicable  to  individual 
values.  Furthermore  he  pointed  out  that  by  using 
probability  theory,  we  might  need  to  resort  to  considerably 
rougher  generalization.  In  their  arguments,  studies  of 
Kolmogorov  (54)  and  Lof  (53)  in  randomness,  probability,  and 
information  connected  with  the  concept  of  calculation 
complexity  provided  for  a  new  insight  into  the  concept  of 
information.  Cerny  and  Brunovsky  (57)  have  taken 
information  as  a  basic  concept,  defining  it  axiomatically . 
Their  definition,  however,  requires  a  special  operator 
instead  of  using  probability  and  independence  as  primitive 
concepts.  Along  with  the  development  of  fuzzy  set  theory, 
Oe  Luca  and  Termini  (55)  as  well  as  Okuda,  Tanaka,  and  Asai 
(58)  have  studied  information  measures  in  connection  with 
the  fuzzy  set  theory.  Although  they  have  defined  fuzzy 
entropy  measures,  it  is  hard  to  be  convinced  that  any  one  of 
them  has  a  sound  basis. 
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4.3.1  Definition 

The  usual  definition  of  entropy  is  based  on  probability 
conceits ,  and  does  not  pertain  to  individual  values,  but 
rather  to  random  values,  i.e.,  to  probability  distributions 
within  a  given  group  of  values.  We  find  it  advantageous  to 
treat  the  total  information  in  the  system  (  input,  network 
topology,  output  )  as  being  comprised  of  two  parts;  namely 
that  due  to  the  randomness  and  vagueness.  Thus  in  addition 
to  the  information  due  to  the  randomness  described  by 
probability  theory  we  recognize  the  fuzzy  information 
contained  in  the  imprecision  of  the  system  described  by 
fuzzy  set  theory.  Consider  a  functional  defined  on  the 
class  of  generalized  characteristic  functions  (fuzzy  sets) . 
We  denote  this  as  "fuzzy  entropy".  Thus  we  obtain  a  global 
measure  of  the  "uncertainty"  related  to  the  situations 
described  by  the  fuzzy  sets.  This  "fuzzy  entropy"  may  be 
regarded  as  a  measure  of  a  quantity  which  is  related  to  the 
randomness  of  the  experiments  and  the  impreciseness  in  the 
system. 

Classical  probability  theory  is  based  on  properties 
such  as  P(ft)=l  (exhaustivity)  and  countable  additivity.  It 
would  be  useful  to  have  a  new  measure  and  calculus  which 
might  eliminate  the  inherent  need  to  be  exhaustive,  while 
restricting  every  sample  point  of  the  structure  to  a 
well-defined  set  (51). 
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Definition  4,1:  Let  B  be  a  Borel  field  (a-algebra)  of 
subsets  of  the  real  line  ft.  A  set  function  x(*)  defined 
on  'a  is  called  a  fuzzy  measure  if  it  hass  the  following 


properties: 

1)  x($)  -  0  is  the  empty  set  of  ft)  (4.3.1) 

2)  X(ft)  =  1  (4.3.2) 

3)  If  ot,  Be  B  with  acS  ,  then  x(a)  £  X  <  3) .  (4.3.3) 

4)  If  {a|l<j<“)  is  a  monotone  sequence,  then  (4.3.4) 

lim  (x(a. ) )  =  X (  lim(a  .) ) . 


Definition  4.2:  Let  y  :  ft -♦[0,1]  and  x  s  { y [  y>x}*[0,l]. 
The  fuzzy  expected  value  (FEV)  of  y  over  a  set  A,  with 
respect  to  the  measure  x(«)  is  defined  as 

FEV (y  )  »  sn  {  min  {  y,  XUX»>  #  (4.3.5) 

where  Sx  »  {y|y>x}CA. 

Definition  4.3:  The  fuzzy  entropy  H(y  )  of  y  over  a  set  A 
with  respect  to  the  measure  x(>)  is  defined  as 

H(y  )  »  -FEV (y  )log2FEV(y  ).  (4.3.6) 

We  may  also  use  the  logarithmic  fuzzy  entropy  defined  by 
DeLuca  (55,56). 

Definition  4,4:  The  fuzzy  entropy  (H(yj  x))  of  y  over  a 
set  A  with  respect  to  the  measure  x ( • )  given  x  is  defined 
as 

H(y|x)  =  -Ay  (x)  log 2  y  (x)  -  (1-  A  )  x($x  )  log2  x(  K  x) 

where  X  .  LEV(p>-xUx>  (4-3-7) 

y(x)-x(£x) 


Theorem  4.1  )  For  any  x  in  a  set  A,  H(  y  )  is  larger  than 
or  equal  to  H(y  |  x) . 

Proof:  Suppose  supremum  of  H(  p  )  occurs  at  x*  in  A,  then 

y  (x*)  ■  x  (  S  x*) . 

H(y)  =  -jj(x*)  log2M(x*) 

H(u)  -  H(y|x)  =  -y (x*) log2y  (x*)  +Xy (x) log2y (x) 

+(l-X)x(Sx)log2x(Sx) 

where  X  =  g-(rxy-I|||"-j-  ,  y(x*)  =  Xy(x)  +  (l-X)X(£x). 

y(x*)  is  in  between  y  (x)  and  x(  5x)  and  -t  logj  t  is  a 
concave  function  and  y(x*>  is  a  linear  combination  of  y{x) 
and  x(  Cx) .  Therefore,  H(  y  )-H(y  |  x)>0.  Equality  holds 
when  X  ■  0  or  1, 

Definition  4.5:  The  fuzzy  mutual  information  H(y  ,  y|x)  is 
defined  by  H(  y  )-H(  y  |  x) . 

Corollary  4.1:  The  fuzzy  mutual  information  H(  y  ,  y  |  x)  is 
a  positive  number. 

Proof:  It  is  a  direct  consequence  of  Theorem  4.1. 

4.3.2  Measurability  of  Faults  in  Analog  Networks 

The  nature  of  symptoms  in  a  faulty  analog  system  is 
usually  not  as  clearcut  as  is  the  case  for  a  faulty  digital 
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system.  Rather,  the  output  responses  are  given  in 
functional  form  and  the  set  of  deviations  of  the  output 
responses  are  potentially  the  symptoms  of  the  several 
component  faults.  We  are  restricting  our  interest  only  to 
such  deviations  as  the  possible  fault  symptoms. 

The  response  deviation  function  C^f.)  of  the  ith 
faulty  component  and  the  jth  port  together  with  fuzzy 
membership  function  fc  (.)  will  form  a  fuzzy  set 

ij 

representing  the  degree  of  fault  response  due  to  the  jth 
port  response  deviation  and  the  ith  component.  The  set  of 
response  deviations  can  be  represented  by  a  semi-closed 
interval,  whose  lower  and  upper  bound  (a.^ .. ,  b^]  may  be 
approximated  by  using  a  worst  case  analysis  (69) .  It  is 
assumed  that  the  response  deviation  interval  X^  due  to  the 
C.j  can  be  predetermined  and  denoted  by  a  fuzzy  set  X.  .  whose 
characteristic  function  is  as  follows. 


1,  xe  (a_  , 


b.  .) 


0,  otherwise. 


(4.3.8) 


It  is  also  assumed  that  the  fuzzy  membership  function 

fc  (.)  is  continuous  and  that  the  values  of  f  (.)  are 

ij  Cii 

assigned  so  that  if  the  reponse  deviation  increases  then  the 

corresponding  fuzzy  membership  values  are  nondecreasing. 

Therefore  the  membership  function  f  (.)  of  the  response 

X  *  * 

1] 

deviations  in  X^.)  with  respect  to  can  be  represented  by 

fX  “Hii <x)Afr  (*).  (4.3.9) 

ij  J  'ij 


-V-* 


r^-r*  » - ■"! 
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We  denote  a  fuzzy  set  (x,fx  >0}  as  Xj^.  Next  we  defined 

ij  "  J 

the  fuzzy  measure  x  ^  j  ( • )  for  the  response  deviation  x^..  as  a 
normed  v;eighted  length  denoted  by 


X 


fx  (t)  dt 

ij 


[h  fx  (t)  dt 
Ja  1  j 


(4,3.10) 


where  Xi  .  =»  { 1 1  a<t<b}. 

We  can  subjectively  interpret  X  —  (x)  as  the  degree  of  belief 
in  the  existence  of  a  fault  when  the  measurements  are  larger 

than  x.  When  fuzzy  membership  function  fx  (.)  is  constant, 

ij 

X  ^ j  < • )  behaves  similar  to  a  uniform  distribution  function  in 
probability  theory. 

Fuzzy  expected  value  for  the  responses  deviation  X . . 

J 

can  be  expressed  as  follows. 


FEV(fx  (x) )  »  sup{  min  fx  (x),X;.s  (x)  ) 
ij  i  j  J 


(4.3.11) 


We  can  easily  show  that  for  any  nondecreasing  continuous 

fuzzy  membership  fv  (x)  over  a  fuzzy  set  X there  exists 

xij 

a  unique  fuzzy  expected  value  of  fv  (x)  with  respect  to  the 
fuzzy  measure  x^j(x). 

In  our  case,  FEV's  are  used  as  measures  of  central 
tendency  for  the  response  deviation  sets  x^'s. 


110 


4.3.3  Fault  Properties,  Fault  Averages,  and  Fuzzy  Expected 
Values 

Even  though  the  set  of  membership  functions  fx. .  (.)'s 
for  each  ith  component  and  jth  response  are  obtained,  the 
problem  of  formulating  a  fault  isolation  criterion  still 
remains.  The  main  reason  is  that  the  set  of  membership 
functions  fx  (.)'s  have  two  properties;  the  occurence  of 
the  ith  component  fault  and  the  subjective  observation  at 
the  jth  response.  On  the  one  hand,  when  we  focus  our 
attention  on  the  occurence  of  a  faulty  component,  we  seek 
some  averaging  method  to  determine  a  typical  fault.  On  the 
other  hand,  we  may  focus  our  attention  on  the  subjective 
interpretation  of  the  faults  at  the  jth  response  to  seek  the 
one  which  exhibits  maximum  deviation  properties.  Therefore 
the  weights  of  individual  properties  and  collective  behavior 
seem  to  have  essential  roles  in  determining  the  likely 
faults.  The  concepts  of  property  set  were  introduced  by 
A.  D.  Allen  (88).  It  seems  reasonable  to  use  FEV's  as  a  set 
of  values  considering  both  properties  and  collective 
tendencies.  It's  interpretation  is  such  that  the  FEV  as  a 
typical  value  of  corresponding  fuzz^  component  membership 
function  and  the  measurement  whose  fuzzy  membership  is  equal 
to  the  FEV  as  the  corresponding  typical  measurement.  The 
criterion  we  are  proposing  for  fault  isolation  is  to  select 
the  minimum  of  the  sum  of  the  difference  between  the 
observed  values  and  the  FEV's  at  each  point. 


Ill 


> 


✓ 


The  FEV^j (x)  for  the  ith  faulty  component  at  jth  port 
are  given  as  follows: 


FEV^  (x) 


FEV { f  (x)) 

Xij 


X  £  X. 


11 


Vc  >  1  ,  x  t  Xij. 

where  c  is  a  constant  determined  by  the  designer. 
The  proposed  criterion  can  be  written  as 


(4.3.12) 


min  E  |FEV.  .  (x)  -  x-  •  (*)  I  • 

i  j  13  13 

Application  of  this  criterion  mainly  depends  on  the 
accuracy  in  determination  of  the  fuzzy  membership  functions. 
Therefore  it  is  vital  to  develop  a  strategy  to  upgrade  the 
accuracy  of  the  response  deviation  membership  function. 


4.3.4  An  Algorithm  of  Fuzzy  Measure  to  Analog  Fault 
Isolation 


Our  objective  now  is  to  minimize  errors  in  fault 
isolation  as  well  as  to  construct  a  structure  for  an 
effective  fault  isolation  scheme.  We  start  by  being  aware 
of  the  possibly  overlapped  response  regions.  Recall  our 
subjective  interpretation  of  a  response  deviation  fuzzy 
membership  value  for  a  particular  response  deviation.  It 
indicates  the  degree  of  fault  due  to  the  component  deviation 
while  all  other  components  are  subject  to  drift  within 
tolerances  and  under  noisy  mesurements.  We  assume  only  a 
single  component  fault  occurs  at  each  set  of  observations. 


The  proposed  algorithm  is  a  follows; 

1.  Set  up  the  set  of  fuzzy  membership  functions  fx  for 

ij 

each  ith  component  and  jth  port. 

2.  According  to  the  fuzzy  membership  functions  fx  ,  set 

ij 

of  fuzzy  measure  X^j’s  are  calculated. 

3.  Fuzzy  expected  values  (FEV's)  are  calculated  using  eq. 
4.3.11. 

4.  Observed  values  are  compared  and  ordered  according  to 
the  criterion. 


rain  X  IfeVj-iU)  -  Xi-j(x) 
i  j  J  J 


The  ith  component  having  the  minimum  indicates 
the  moat  likely  fault. 

5.  Confirmation  of  correct  isolation  directs  the  update 
of  fx. ,'s.  Suppose  xQ  is  the  observed  set  of  values. 


fx  00  *  «fX  (x)+  (l-a)<Mx),  0  <  '<■  <  I 

ij  ij 


4>  (x) 


-  (> 


X (x-x  )  f  1  if  x  >  x 


if  y  (x) 

Xij 


0  otherwise 


where  x,  x  e  x  . 


When  x0  is  correctly  classified  this  information 
reinforces  the  correct  decision  for  the  next  similar  fault. 
When  xQ  is  incorrectly  classified  we  do  not  use  it  to  update 
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Xij 

6.  When  we  have  new  observations  for  a  different  unit 
under  test  go  to  step  2. 

A  macro  flow  diagram  of  this  algorithm  is  shown  in  Pig. 
4.1.  in  this  way  we  may  able  to  start  fault  isolation  even 
though  there  exist  overlapped  responses  and  the  probability 
distribution  of  the  fault  response  deviation  are  not 
precisely  specified. 


4.4  A  Fault  Isolation  Method  in  Nonlinear  Analog  Networks 
Using  Fuzzy  Distance  Measure 

As  a  possible  means  of  representing  fault  patterns,  we 
can  use  power  measurements.  We  utilize  a  special  form  of 
Tellegen's  theorem  to  get  the  necessary  values  of  port 
currents  and  voltages  for  diagnostic  purposes.  Furthermore, 
we  present  an  algorithm  that  makes  use  of  the  available 
measured  data  on  port  responses  to  isolate  the  faulty 
components  using  fuzzy  distance  measure  detailed  in  section 
4.2.  An  illustrative  example  using  the  NAP 2  Network 
Analysis  Program  is  included.  The  results  are  compared  with 
other  criteria. 

4.4.1  Introduction 

In  analog  electronic  networks  which  are  designed  to 
perform  certain  analog  functions,  probability  distributions 
for  the  value  of  each  component  are  often  available.  It  is, 
however,  still  difficult  to  calculate  the  port  responses 
from  such  network  component  data.  Moreover,  the  nominal 
port  response  which  is  the  subset  of  all  the  possible  port 
responses  could  be  rather  imprecise  because  it  is  only  given 
by  the  actual  designer's  experiences  or  by  calculated  values 
assuming  some  specific  preset  normal  conditions.  Whenever 
actual  measurements  fall  in  the  predetermined  fault 
conditions,  due  to  the  port  responses,  impreciseness  in  the 
criteria  of  the  predetermined  fault  conditions,  and  the 
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inadequacy  of  available  ports,  the  faulty  nonlinear  analog 
network  can  be  interpreted  as  a  fuzzy  system. 

Herein  we  present  an  algorithm  to  make  use  of  all  the 
available  data,  namely  data  on  port  responses  to  isolate  the 
faulty  components  using  fuzzy  set  concepts.  Also,  a 
possible  way  of  selecting  a  set  of  features  leading  toward 
better  fault  isolation  is  briefly  studied. 

Using  a  network  analysis  computer  program,  we  can  get 
the  port  responses  for  both  nominal  and  faulty  conditions. 
A  special  form  of  Tellegen's  theorem  is  applied  to  get  the 
necessary  values  of  port  currents  and  voltages  for 
diagnostic  purposes. 

4.4.2  Reference  Feature  Generation  of  Faulty  Networks 
using  Tellegen's  Theorem 

Throughout  this  section,  we  assume  that  only  a  single 
component  fault  occurs.  This  assumption  is  mainly  for 
notational  convenience.  Recall  that  a  "soft  failure" 
entails  a  change  of  component  value  to  such  a  degree  that 
the  network  response  is  just  outside  the  specification  while 
all  the  non-faulty  components  are  subject  to  drift  within 
their  tolerance  ranges.  It  has  been  discussed  (12)  that 
such  failures  are  more  troublesome  to  isolate  than  "hard 
failures"  such  as  an  open  or  short  circuit  of  the  component. 
We  restrict  our  discussion  only  to  "soft"  failures.  If 


117 


desired,  a  "hard"  failure  can  be  approximated  by  the  extreme 
case  of  "soft"  failure. 


One  of  the  most  powerful  tools  available  to  solve  the 
network  is  Tellegen’s  theorem.  One  general  statement  of 
Tellegen's  theorem  is  stated  as  follows: 


E  A  i  A  v  =  E  A '  x  A  v 
D  P  a  a 

o  v  *■  a 


(4.4.1) 


where  ip,  vp  are  port  currents  and  voltages;  and  ia,  va  are 


branch  currents  and  voltages.  A 1  and  A"  are  any  Kirchhoff 
operators.  The  above  theorem  can  be  applied  to  networks 
including  non-linear  elements  as  long  as  the  network 
topology  is  not  changed.  We  proceed  to  apportion  the 
currents  anci  oltages  at  the  ports  and  branches  respectively 
to  be  consistent  with  their  nominal  values  and  their  faulty 
values  as  follows: 


i  (t) 
P 

-  ip(0,(t)  +  i.pU)  (t) 

(4.4.2) 

v  (t) 

-  v  ♦  v  »>,« 

P 

P  P 

(4.4.3) 

ia(t) 

=  ia(°> (t)  +  ia(1> (t) 

(4.4.4) 

va(t) 

=  va(0) (t)  +  va(1) (t) 

(4.4.5) 

where 

stands  for  nominal  portion  and  ^ 

stands  for 

faulty  port: on.  Then  we  find  that  Tellegen’s  theorem  is 
expressible  as  four  separate  expressions: 


& 


•  -  to*. 
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>:i  (0>v  <°>  =  Ei  t0>v  (0) 
p  p  a  a 

p  1  r  a 

(4.4.6) 

Ei  (0>v  (1)  .  Ei  (0)v  (1> 

^  P  P  a  a 

p  1  a 

(4.4.7) 

Ei  (1>v  <°>  =  Ei  (1>v  (0> 
p  p  a  a 

p  *  f  a 

(4.4.8) 

Ei  (1>v  (1)  -  U,111.,111 

(4.4.9) 

-  p  p  „  <*  a 

In  contrast  with  the  power  equation  (4.4.6),  we  can 
call  eqs.  (4. 4. 7),  (4.4.8),  (4.4.9)  pseudo-power  equations. 
Port  responses  under  the  nominal  faulty  conditions  can  be 
calculated  easily  using  a  network  analysis  program.  We 
assume  that  the  port  currents  and  voltages  of  the  nominal 
network  which  have  n  components  and  m  ports  are  represented 


as  i(0) 
aa  xpl 


(nominal  case) 


and 


j^v  (k  component  faulty  case)  . 


The  corresponding  faulty  network  port  currents  and 


voltages  are  represented  by 

/  id)  i<l>  VU>  VU>» 

Vpl  '**•'  kxpm  '  k  pi  '  '  k  pm  ’ 


(4.4, 10) 


.  *  AO)  .  .(0)  .  ..(0)  (0) 

"  (k  pl"lpl  kXpm  xpm  '  k  pi  pi  k  pm  pm  '* 

We  then  have  three  possibly  independent  equations  for 


each  k: 


II  <°>  v  <l)  =  ti  (0>  V  (1) 
ok  aka 

p  •  a 


(4.4.11) 


(4.4.12) 
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V  (1)v  (0)  =  Z>i  {1)V  (0> 
pk  P  P  ak  a  a 

J.i  (1»  v  =  E  i  <!>  v  (1» 
K  p  kp  k  a  ka 

p  a 


(4.4.13) 


Thus  it  is  clear  that  we  have  the  port  measurements  for 
the  nominal  and  typical  single  fault  cases.  The  problem, 
however,  is  how  to  isolate  the  faulty  component  from  given 
measurements.  We  can  select  port  voltages  and  currents 
independent  of  each  other  by  forming  the  appropriate 
spanning  tree  of  the  network.  From  eq,  (4.4.10),  we  can 
generate  the  2m  possible  equations  by  choosing  ports.  Then, 
we  have 


i<0)  v(l>  =  . 
p£  k  p£ 


7  i(0) 

/:r  p*' 


v(i) 
kp  V 


+  T.i 


(°)  (!) 
ct  k  a 


(4.4.14) 


where  JL  ■  1. .  .m. 

From  eq.  (4.4.14),  we  get  m  independent  equations 
where  the  lefthand  sides  are  known  and  the  corresponding 
righthand  sides  are  unknown.  These  equations  show  that  the 
pseudo~power  disturbance  due  to  the  one  faulty  component  is 
revealed  by  the  port  responses.  We  will  use  the  lefthand 
side  quantity  to  isolate  the  faulty  component.  Likewise  eq. 
(4.4.12)  and  (4.4.13)  yield  2m  more  possibly  independent 
equations.  By  suitable  extension  of  this  approach,  multiple 
component  fault  cases  can  be  handled. 


 1  ** 
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4.4.3  Fuzzy  Distance  Measure  in  Fault  Isolation 


We  assume  that  the  system  has  n  single  fault  cases.  We 
further  assume  that  every  fault  that  occurs  is  near  the 
typical  single  fault  calculated  by  the  present  conditions. 
Herein  we  are  only  interested  in  isolating  faulty  units 
under  test  to  the  given  fault  cases. 

Then  the  problem  of  fault  isolation  reduces  to 
determining  the  maximum  equivalence  between  measurement  y ^ 
of  unit  under  test  Y  and  preset  values  jo ^ ’  s  of  typical 
lault  X . ,  where  j  stands  for  number  of  measurements  made  and 

i 

i  stands  for  different  fault  cases.  Since  independency  of 
the  measurement  data  are  not  given  precisely,  we  use  fault' 
equivalence  (j(Y=Xi)  as  a  simple  averaging  of  the  port  fault 
equivalence  . 

4.4.4  A  Fault  Isolating  Algorithm  Using  the  Fuzzy  Set 
Concept 


A  description  of  a  proposed  algorithm  is  as  follows: 

1.  Calculate  port  voltages  and  currents  under  nominal  and 
faulty  conditions  using  a  network  analysis  program. 

2.  Calculate  pseudo-powers 

<  (0)  v  u>  i  (1)  i  (1>V  (0)  i  (1)  v  (1) 

p  k  p  '  k  p  '  kxp  Vd  '  k  p  k  p 

for  all  k’s  and  p's.  It  is  assumed  that  the  m(sn) 

independent  ports  are  available,  and  we  have  l  faulty  cases 
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and  n  components. 

3.  Form  a  pseudo-power  matrix  X*  which  has  columns  and  m' 


X  = 


rows  as 

follows : 

•i  (0) 

v  {1) 

•  (0) 

V  (1)  ! 

!  pl 

lVpl  *  *  * 

pl 

£pl  =  *  xl 1*  *  • 

!  i;  <°> 

V  (1) 

i  {0> 

V  {1)  : 

!  pm 

1  pm 

pm 

£  pm  ij 

i 

i  <l> 
pi 
* 

v  (0) 
lvpl  ‘  *  ’ 

i 

Pl 

(0)  •  .  x,  . . . 

»v  .  •  3ml 

l  pl 

.*  (1) 

(0) 

,  (1) 

„  (0) 

i 

pm 

1  pm 

pm 

£vpm 

i  a) 

v  (1) 

i  (1) 
pl 

v  {1) 

pi 

• 

lVpl  *  *  * 

tpi 

i:  (1) 
v  pm 

v  (1) 

1  pm 

i  (1) 
pm 

v  U) 
l  pm 

'll' 


x  ~  i  x ^ 

i 

X  |  •  X  |  n 

nr  1  nr l 


X*  is  formed  by  reducing  X. 

If  jth  row  of  X  is  all  zeroes, 
then  jth  row  is  deleted. 


4.  A  measure  of  separability  is  formed  to  assess  the 
diagnostic  worth  of  jth  set  of  measurements.  When  we  order 
xij  ^or  every  given  j(  *  l,...,m'),  we  get  new  matrix  Y, 
where  its  element  y^  is  ordered.  We  set  the  measure  ,  as 


f-lY  .-Y  . 

s  ,  =  z  3 


Y  t i  . -y  . 
3+1*3 


1  L  v~*  Tv  *  "*  l09v  _v 

J  q=re,j  i, j  Y£,j  Yi,j 
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v 


* 


If  the  measurements  are  evenly  spaced,  then 

S.  =  -n*-  log-  =  -log-  =  log n  . 

3  n 

If  the  measurements  are  spaced  unevenly,  then 
S..  <  log  n.  Therefore  indicates  the  diagnostic  worth  of 
jth  set  of  measurements. 

5.  Measure  the  output  port  voltages  and  currents  of  unit 
under  test  simultaneously.  The  voltages  and  currents 
representing  faults  are  indicated  by 


lp'  1*  *  *  Vm'  '  p'l- 


v 


p'm' 


6.  Calculate  the  rank  order  for  each  jth  row. 

a.  If  there  are  i'  equal  values  at  { i , . . . (i+i ' -1) } th 
order  then  the  rank  would  be 

[i  x  ...  x  (i+i '  -1)  ]  , 

b.  Remember  the  zero  crossing  rank  order. 


If  zero  crossing  occurs  between  {i",  i"+l}th  order,  then  the 
zero  crossing  rank  is  (  U"  x  (i"+l)) 


7.  An  attribute  to  the  rth  fuzzy  membership  is  given  by 

p^_.  =  1  -  log^  (rank  order  of  rth  component) 
where  0  <  P  .  <  1. 

n 


! 


-  w  .  .-I 


Fig  4.2  Simplified  Diagram  of  Fault  Isolation  Method 
Using  Fuzzy  Distance; 
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8.  The  fuzzy  membership  is  given  by  the  average  of  P 


ur  m'  ^  Pr  j  * 
j  =  i 


9.  Order  the  fuzzy  membership  function.  The  maximum  of  the 
fuzzy  membership  function  indicates  the  most  likely  fault. 
The  relative  valus  of  fuzzy  membership  function  will  also 
have  some  meaning. 

10.  Validity  of  the  Test:  Noting  that  fuzzy  membership 
0<  y<l,  we  define  test  criteria  as: 


a.  1  indicates  high  confidence  in  the  decision. 

IuclX 

li  -y 

^  _  may  nom  „  , _ _ 


.  Let  GL  «  "Jog "2 — •  A  large  Gl  indicates  an  effective 


test. 


c.  Let  G2  **  '‘max  psec  max  .  A  largo  G2  also  indicates 


an  effective  test. 


log^2 


11.  If  the  resulting  decision  is  not  satisfactory,  return 
to  step  4  *nd  select  new  port  measurements  with  good  local 

separability  S  •  near  troublesome  components. 

H  J 


E  Yq^2r-3,  j~Yq,  j  log 


qi  r=l  Y  -y 

i.  j  i.j 


where  q  Is  the  component,  j  is  the  new  port  measurement, 
Simplified  "lew  diagram  is  shown  in  Fig.  4.2. 


-•  "i. 
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Table  4.1  List  of  Selected  Faults 

FAULTS  INSERTED 

1.  Open  -12V  source 

2.  Open  5V  source 

3.  Open 

4.  Open  12V  source 

5.  Ql  short  emitter  to  collector 

6.  Open  R2 

7.  Short  R2 

8.  R3  increase 
9  CR1  short 

10.  R5  increase 

11.  Q4  short  emitter  to  collector 

12.  Q3  short  base  to  emitter 

13.  R6  open 

14.  Short  CR3 


Fig.  4.3  Partial  Diagram  of  the  Communication  I/O  Circuit 


FAULT  DESCRIPTION 
R3  and  R5  open 
Base  of  Ql  open 
R^  open 

R2,  R6  and  emitter  of  Q2  open 

Replace  0.1  to  emitter  to 
collector 

R2«-109fl 
R2«-0.10 
R3*2  x  R3 
CRl«-0.in 
R5+2  x  R5 

Replace  O.lfi  to  emitter  to 
collector 

Replace  0.1R  to  base  to  emitter 

R6*-109fi 

CR3-O.U2 


I 


^-rr^T v&sis&aKgfr. 
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4.4.5  An  Illustative  Example 

We  use  the  Line  Receiver  Circuit  of  the  communication 
I/O  circuit  card  shown  in  Fig.  4.3  which  has  4  transistors, 
3  diodes,  6  resistors,  1  capacitor,  3  power  sources,  1  input 
port,  and  1  output  port.  For  convenience  we  assume  the  14 
fault  cases  shown  in  table  4.1.  The  NAP2  Nonlinear  Analysis 
Program  is  used  to  simulate  the  circuit  and  calculate  the 
port  measurements.  We  measure  the  output  port  voltages, 
currents  and  the  input  port  currents  with  0  and  5.5V  at  the 
inprt  port,  out  of  12  sets  of  pseudo-power  measurements,  5 
sets  of  pseudo-power  measurements  are  retained.  We  have  3 
samples  for  each  fault  type.  Each  fault  type  is  recognized 
by  a  specific  fault  condition  with  all  the  other  components 
subject  to  drift  with  normal  distribution  within  5  percent 
of  their  nominal  values.  Table  4.2  shows  the  number  of 
correct  diagnoses  for  each  fault  type  based  on  a  fuzzy 
distance  criterion  and  the  nearest  neighbor  rule.  Using  the 
algorithm  with  a  fuzzy  distance  criterion,  we  find  that  36 
out  of  42  samples  are  correctly  classified.  Under  the  same 
conditions,  the  nearest  neighbor  rule  classifies  only  28 
samples  correctly.  Table  4.3  illustrates  the  effectiveness 
of  test  G2 ,  defined  in  tie  previous  section,  for  14  sarnies. 
In  this  table,  fault  type,  2  is  classified  incorrectly.  This 
is  not  suprising  since  this  fault  yields  a  very  low 
effectiveness  value. 
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4.4.6  Discussion  and  Futher  Remarks 

A  key  point  in  this  approach  is  that  such  fault 
isolation  is  in  fact  converted  to  a  simplified  form  of 
pattern  recognition.  We  feel  that  because  of  availability 
for  very  limited  number  of  samples  of  fault  measurements, 
the  nearest  neighbor  rule  might  be  inadequate  as  a  decision 
criterion.  At  the  same  time,  the  voting  technique  is 
avoided,  because  it  requires  an  optimum  threshold  level 
which  is  not  easy  to  obtain.  Although  the  number  of  samples 
is  very  limited,  results  appear  to  show  rather  easy  and 
effective  diagnosis  possible  based  on  a  fuzzy  distance 
measure . 


2. 
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4.5  An  Application  of  Fuzzy  Entropy  Measure  for  Analog 


Fault  Isolation 
4.5.1  Introduction 


i 

i 

i 

u 

3 


The  deviation  from  the  normal  responses  in  analog 
networks  can  be  viewed  as  functions  of  the  variability  of 
the  faulty  components.  However  several  ambiguities  arise: 
due  to  nonlinearity,  component  drift,  and  noise.  These 
along  with  changing  ambiguity  in  different  stages  are 
interpreted  in  the  context  of  a  fuzzy  system.  A  fuzzy 
measure  is  Introduced  to  facilitate  analog  fault  diagnosis 
under  these  circumstances. 

For  problems  of  automatic  analog  fault  isolation,  one 
can  as  already  indicated  adopt  the  viewpoint  of  pattern 
classification.  In  the  pattern  classification,  many  of  the 
theoretical  problems  have  been  resolved  by  using  statistical 
methods.  However,  in  practical  analog  fault  dignosis, 
almost  all  of  the  available  statistical  methods  encounter 
rather  unrelistic  assumptions  such  as  the  availability  of 
very  large  sample  sizes  and  known  probability  distribution 
of  the  systems.  On  the  one  hand  for  the  specific  case  of 


analog  fault  isolation,  we  usually  have  avaialable  a  large 
amount  of  information  in  the  form  of  a  circuit  description. 
On  the  other  hand  we  often  have  only  limited  sample  sizes 


for  characterizing  the  type  of  faults.  The 
density  is  unknown  or  at  best  only  partially 


probability  : 

< 


known . 


Also 
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under  the  framework  of  existing  statistical  distance 
measures,  it  is  very  difficult  to  take  the  contextual 
information  of  the  fault  pattern  into  consideration. 
Furthermore  the  increased  computational  efforts  required  for 
effectiveness  of  certain  existing  statistical  analog  fault 
isolation  methods  must  be  traded  off  against  the 
classification  error  reduction  obtained.  Therefore  we  must 
balance  the  need  for  computational  simplicity  and  the  level 
of  exactness.  It  seems  both  appealing  and  useful  to  adopt 
the  fuzzy  set  idea.  In  this  way  we  enhance  fault  isolation 
and  maintain  the  level  of  ambiguities  in  the  fault  isolation 
procedure  while  achieving  the  necessary  output  requirements. 
Because  of  the  ambiguities  in  the  procedure  not  only  the 
most  likely  fault,  but  also  the  ordering  of  the  possible 
faults  retains  some  significance. 

With  this  in  mind,  we  formulate  the  fault  isolation 
problem  utilizing  the  fuzzy  set  concept  which  will  enhance 
the  7\TPG  effort.  A  fuzzy  entropy  measure  was  developed  in 
section  4.3  utilizing  vague  measurements  for  isolating 
faulty  components  in  analog  systems.  An  applicable  fault 
isolation  algorithm  is  given  next  based  on  the  fuzzy  entropy 


measure. 
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4.5.2  A  model  of  Fault  Membership  Function  of  the  Response 

When  there  is  a  fault  in  an  analog  electronic  network, 
it  usually  means  the  observed  response  is  out  of  the 
tolerance  limit  for  that  particular  nominal  response. 
Therefore,  the  fault  is  a  function  of  the  deviation  from  its 
nominal  response.  It  is  often  true  that  the  deviation  from 
its  nominal  response  tends  to  increase  when  the  component 
deviation  from  its  nominal  value  increases.  We  shall 
distinguish  three  cases  of  faults.  One  can  logically  assume 
that  when  the  response  deviation  departs  from  its  tolerance 
limit  the  network  is  considered  faulty.  Initially,  fuzzy 
membership  0  is  arbitrarily  assigned.  By  the  decision 
maker's  choice,  when  the  deviation  reaches  a  certain  point 
B  the  network  is  definitely  faulty.  Fuzzy  membership  1  is 
assigned  at  this  particular  point.  Beyond  this  point,  no 
matter  what  the  observations  or.  the  network,  the  assignment 
of  the  fuzzy  membership  values  for  the  deviation  remains  1. 
There  is  a  gradual  transition  region  between  the  fuzzy 
membership  assignment  of  0  and  1.  For  simplicity,  in  this 
region  we  assume  that  the  degree  of  fault  increases  linearly 
due  to  the  increment  of  the  deviations.  Fig.  4.4  shows  the 

simple  model  of  the  network  fault  membership  function  R  at 

j 

jth  response  deviation  as  a  fuzzy  membership  function  of 
response  deviations  described  above. 

Now  let  us  turn  our  attention  to  the  network  fault  due 
to  a  specific  faulty  component.  We  are  restricting  our 


1 
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jth  response  deviations 


Fig.  4. 4  A  Network  fault  membership  function 


0  _  _  /„_  _  .  _  ; _ 

n  Y  2  yV”r~" 

jth  response  deviations 
due  to  ith  faulty  component 

Fig.  4.5  A  Component  fault  membership  function 


a  Yi  Y2  ^  Y 3  R} 

jth  response  deviations 


Fig.  4.6 


ihe  network  fault  membership  function 
due  to  ith  component  fault 
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intreat  to  isolating  the  single  fault  case  only.  By  a 
similar  reasoning  as  network  fault,  for  each  component 
deviation,  we  consider  three  response  deviation  points  y-^ 
Y2,  and  y^  as  the  response  deviations  when  the  component 

is  on  the  verge  of  its  tolerance  limit,  when  the  component 
is  its  usual  fault  state  chosen  by  the  decision  maker,  and 
when  the  component  is  at  its  extreme  value  such  as  an  open 
or  short.  Fig.  4.5  shows  this  model  of  the  component  fault 
membership  function  uR  as  a  function  of  ith  response 

ij 

deviation  due  to  a  specific  fault  component. 

A  network  fault  membership  function  due  to  the  jth 

faulty  component  yc  is  defined  to  be  the  minimum  of  the 

ij 

network  fault  membership  function  and  ith  component  fault 
membership  function.  Fig.  4.6  shows  the  network  fault 
membership  function  due  to  the  ith  faulty  component. 

The  initial  measure  y (  £  )  is  calculated  as 

ij 

£v.(t)  dt 

-  .  (4.5.1) 

c..(t>  dt 
13 

The  FEV  of  c  ,  .  is  calculated  as 

13 

FEV (c . . )  =  sup  {min  (y  (x) ,  u(C  )).  (4.5.2) 

3  xeR.  cij  xij 

We  may  also  update  the  initial  fuzzy  measure  y  (  c  )  by 

c .  . 

adding  new  information  from  "correct  data".  A  set  of 
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"correct  data"  is  obtained  by  the  success  of  actual  faulty 
component  replacement  as  determined  by  the  criterion 
discussed  in  the  previous  chapter.  One  method  using  linear 

reinforcement  scheme  is  as  follows. 

\  h  (t)  +a6(t-t*)  dt 

-  r^rtT  Tt  '*"5- —  (4-5-3) 

13  Jo  cij 

where  6 (t)  is  a  unit  impulse  function,  0  £  a<l,  and  t* 
denotes  a  correct  observation. 

4.5.3  A  fault  Isolation  Algorithm  using  Fuzzy  Entropy 
Criterion 

It  is  again  assumed  th<  t  we  have  n  single  fault  cases 
(i  »  l,...,n)  and  m  different  response  setups  (j  *  l,...,m) 
available.  From  the  fuzzy  membership  function  w  ^ci j  <x) ) 
and  the  fuzzy  measure  \i  {  )  described  in  the  previous 

ij 

section,  we  can  calculate  FEV(cij)  for  such  jth  response  and 

ith  component  fault.  When  there  is  a  set  of  observations 

(x1#...,xn)  for  the  response  deviations  at  the  response 

setup  ( , . . . , R  )  from  UUT,  the  observations  are  adjusted  by 

an  amount  of  the  difference  between  the  response  deviation 

at  the  FEV  and  the  response  deviation  of  .  For  new 

adjusted  observations  (x1,...,xn),  \i  (c^  (x  ))  and  p  ( 

C  )  for  each  jth  response  and  ith  component  is 
Xi  j 

calculated. 

Our  objective  is  to  determine  i  while  minimizing  the 
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UUT 

Observed 

[)at£ 

y= 

<X1 

la} — 
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possible  number  of  incorrect  decisions.  As  a  possible 
criterion,  we  are  proposing  that  we  find  i  such  that 

(4.5.4) 

min  1  J .  . (x) 
i  j  13 

where 

J.  (X)  *  I!(FEV(c.  .)  )-XH(p(c.  .  (x)  )-(l-X)H(y(C  )),  (4.5.5) 

j  j  j  13 

FEV(Cij)-uUXi  ) 

H(t)  =  -t  log„(t)  and  X  '=  - — 

u  (c.  .  (x)  ) -|J  (f  ) 

13  xij 

After  gathering  some  correct  data,  we  can  update  the 
fuzzy  measure  g  (*;  }  .  A  flow  diagram  of  the  described 
algorithms  is  given  in  Fig.  4.7. 

4.5.4  An  Illustrative  Example 

To  facilitate  comparisons  we  use  the  same  circuit  and 
the  same  14  faults  as  that  given  in  section  4.4.  We  measure 
the  output  voltages,  currents  and  the  input  port  currents 
with  0-  and  5.5-V  excitation  at  the  input  port.  We  obtained 
three  samples  for  each  fault  type  using  the  NAP2  Nonlinear 
Analysis  Program.  Each  fault  type  is  recognized  by  a 
specific  fault  condition  with  all  other  components  in  this 
circuit  subject  to  drift  within  5%  normal  distribution.  For 
simplicity,  we  assume  that  the  network  starts  being  assigned 
faulty  membership  at  5%  response  deviations  and  the  network 
is  definitely  classified  as  faulty  after  10%  response 
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*  deviations.  As  an  initial  guess,  we  also  assume  that 

y1#y2,y3  as  ®0'  100,  and  HO  percent  of  the  typical 

response  deviations  of  the  given  faulty  component.  Table 
4.4  shows  the  number  of  correct  diagnoses  obtained  for  each 
fault  type  based  on  the  fuzzy  entropy  criterion  with  the 
results  obtained  in  section  4.4.  We  find  that  32  out  of  42 
samples  are  correctly  classified  using  the  fuzzy  entropy 
criterion  vhile  the  nearest  neighbor  rule  classified  only  28 
samples  correctly. 

4.5.5  Discussion  and  further  remarks 

A  fault  isolation  method  for  analog  circuits  is 

*  discussed  using  fuzzy  set  concepts.  Even  though  the 
information  derived  from  the  circuit  under  tost  is  usaually 
inadequate  to  apply  statistical  methods,  application  of  our 
fuzzy  measure  can  provide  adequate  fault  isolation 
capability.  The  reason  seems  to  be  that  the  proposed 
algorithm  includes  an  experienced  designer's  notion  of 
"fault"  which  tends  to  enhance  decision  making.  Also  the 
upper  and  lower  bounds  of  the  response  deviations  contribute 
to  improve  the  decision  through  the  proposed  simulation 
model. 
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4.6  Chapter  Summary 

An  evaluation  of  analog  fault  isolation  techniques  is 
attempted  through  a  fuzzy  distance  measure  and  a  fuzzy 
entropy  measure.  A  metric  on  the  lattice  giving  a  measure 
of  the  "distance"  apart  of  two  propositions  under  a 
valuation  is  defined  as  the  logarithmic  value  of  the  rank 
order  of  the  two  propositions.  And  its  quasimetric 
properties  are  discussed. 

The  "fuzzy  entropy"  is  introduced  as  a  measure  of  a 
quantity  which  is  related  to  the  randomness  of  the 
experiments  and  the  impreciseness  in  the  system.  The  fuzzy 
entropy  is  defined  as  the  information  contained  in  the  fuzzy 
expected  value. 

Fault  properties  in  connection  with  the  fuzzy  measure 
are  discussed.  These  fuzzy  measures  are  the  bases  for  fault 
isolation  algorithms.  The  results  of  simulation  study  based 
on  these  decision  criteria  yield  improved  fault  isolation. 
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CHAPTER  5  CONCLUSION  AND  SUGGESTIONS  FOR  FUTURE  RESEARCH 
5.1  Summary  and  Conclusion 

To  attack  the  long  standing  fault  isolation  problem  in 
analog  electronic  circuits,  we  have  focused  on  two  of  the 
major  problems.  One  is  the  presence  of  uncertainties  sucn 
as  indeterminacy,  vagueness,  randomness,  and  so  on  that 
naturally  arise  during  the  solution  procedure  of  analog 
fault  isolation.  The  other  is  the  presence  of  topological 
restrictions  inherent  in  specific  circuit  configurations. 

Our  main  attention  was  focused  on  dealing  with  the 
fault  isolation  problem  involving  various  kinds  of 
uncertainties  such  as  indeterminacy  or  vagueness.  We  show 
that  such  problems  lend  themselves  very  well  to  and  in  fact 
can  be  solved  by  adopting  fuzzy  set  concepts.  In  particular 
this  line  of  research  has  produced  a  modified  fuzzy  set 
technique  applicable  to  automatic  fault  isolation. 
Topological  aspects  utilizing  graph  theory  may  be  used 
effectively  to  assist  in  preanalysis  of  faulty  analog 
electronic  circuits.  As  a  spin  off  of  a  consideration  of 
these  problems,  we  developed  some  new  theorems  for  element 
value  solvability.  It  should  be  made  clear  however  that 
effective  fault  isolation  can  be  accomplished  with  or 
without  thi£  preanalysis  to  assist  in  resolving  the  more 
fundamental  problem  incurred  by  uncertainty. 

As  a  consequence,  this  research  yields  the  following 


specific  results: 

1.  A  base  line  automatic  isolation  system  which 
can  be  used  to  deal  with  various  kinds  of 
uncertainties.  A  fuzzy  automaton  model  served 

as  a  point  of  departure  for  the  base  line  system. 
Various  fuzzy  relations  are  used  to  select  and 
update  the  parameters  and  structures  of  the  system. 

2.  Set  of  algorithms  and  new  decision  criteria  which 
can  be  implemented  easily  and  used  for  effective 
fault  isolation.  A  fuzzy  distance  measure  and  a 
fuzzy  entropy  measure  are  used  for  decision  making 
in  the  fault  isolation  algorithms.  The  results 
are  shown  to  be  generally  more  effective  than 
existing  techniques. 

3.  Ample  illustrative  examples  and  simulation  studies 
are  included  to  back  up  these  new  methods.  Several 
examples  such  as  low  pass  filter,  band  pass  filter, 
and  communication  I/O  circuits  are  used  to 
illustrate  the  simulation  studies.  The  results  of 
simulation  studies  demonstrate  the  applicability  of 
a  fuzzy  set  technique. 


5.2  Suggestions  for  Future  Studies 


The  following  topics  are  suggested  for  future 
investigation : 
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1.  Future  investigation  on  the  properties  of  fuzzy 
sets  is  needed  to  adapt  and  facilitate  its 
applicability  to  multiple  fault  cases. 

2.  Further  investigation  on  refining  the  proposed 
single  fault  techniques  to  achieve  potential 
improvements  in  the  order  of  50%. 

3.  Based  on  extension  of  the  analog  fault  diagnosis 
algorithm,  fault  diagnosis  of  hybrid  electronic 
systems  needs  consideration  and  further  intensive 


efforts. 
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Appendix  A 

Graph  Theoretic  Aspects  of  Analog  Fault  Isolation 

The  state  of  art  in  fault  analysis  of  analog  networks  using 
graph  theory  is  reviewed  briefly  and  some  possible 
extensions  are  explored.  In  particular,  the  topological 
interpretation  including  network  solvability  and  the  key 
subgraph  concept  are  reviewed  and  extended.  A  new  algorithm 
to  determine  solvability  baaed  on  network  topology  is  given. 
This  graph  theoretical  approach  is  useful  to  determine  the 
suffiency  of  the  available  access  points.  Therefore  this 
graph  theoretical  approach  can  be  used  as  a  preanalysis  for 
the  application  of  fuzzy  set  technique. 

A. 1  Introduction 

In  the  body  of  the  dissertation,  we  have  been  applying  the 
fuzzy  set  concepts  to  alleviate  some  of  the  difficulties  of 
handling  the  fault  isolation  of  analog  networks  in  the 
single  fault  case.  Graph  theory  is  used  to  investigate  a 
specific  network  structures.  Furthermore  enumeration  of  the 
possible  number  of  measurements  on  linear  networks  with 
N-accessible  terminals,  we  gain  insight  into  the  behavior  of 
faulty  analog  networks. 

Conventional  graph  theoretical  aspects  previously  applied 
for  analog  fault  dignosis  will  be  briefly  discussed. 
Especially  the  network  solvability  and  key  subgraph  concepts 
will  be  reviewed  and  extended.  The  connection  of  graph 
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theory  with  fuzzy  sets  for  application  to  analog  fault 
diagnosis  is  also  indicated. 

A. 2  Existing  Graph  Theoretic  Aspects  of  Analog  Fault 
Isolation 

A  graph  representation  for  network  dates  back  to 
Kirchhoff  (1847) .  Hence  the  applications  of  graph  theory  to 
the  analysis  and  design  of  electrical  network  is  not  new. 
But  applications  of  graph  theory  to  network  analysis  did  not 
prove  to  be  advantageous  until  the  advent  of  the  high  speed 
digital  computer.  More  recently  applications  of  graph 
theory  for  the  fault  analysis  of  combinatorial  networks  or 
digital  networks  have  been  made  quite  successful  (81).  Yet, 
applications  of  graph  theory  to  analog  fault  analysis  have 
been  relatively  infrequent.  Berkowitz  (74)  developed  the 
concept  of  element  value  solvability  for  passive  linear 
lumped  network.  Bedrosian  introduced  the  key  subgraph 
concept  to  provide  some  insight  into  solutions  of  active  as 
well  as  passive  lumped  networks.  Identification  of  the  key 
subgraph  leads  directly  to  a  set  of  equations  which  in  the 
case  of  a  single  element  kind  network  is  an  homogeneous 
multilinear  algebraic  form.  Very  recently  Navid  and  Willson 
(14)  presented  some  sufficient  conditions  for  the  element 
value  solvability  for  linear  elements.  Here  we  present  a 
method  of  determining  necessary  conditions  to  the  network 
solvability  which  is  tighter  than  that  given  by  Berkowitz. 
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A. 3  Element  Value  Solvability 
A.3ol  New  Theorems 


We  start  with  a  few  definitions: 

Definition  A.l)  Available  nodes  (A)  :  External  network 
nodes  at  which  voltages  and  currents  can  be  applied  and/or 
measured.  In  other  words,  available  node  can  be  opened  or 
shorted. 

Definition  A. 2)  Partly  available  nodes  (P)  :  External 
network  nodes  at  which  voltages  can  be  applied  and/or 
measured  but  currents  can  not  be  applied  or  measured.  In 
other  words,  a  partly  available  node  can  be  shorted  but  can 
not  be  opened. 

Definition  A. 3)  Nonavailable  nodes  (I)  :  Nodes  internal  to 
network  at  which  neither  voltages  nor  currents  can  be 
measured . 


Definition  A. .4)  Key  subgraph  (K)  :  The  subgraph  of  network 
N  which  consists  of  the  subset  Bk  of  all  branches  incident 
on  all  the  nonavailable  nodes. 

Definition  At_£)  Core  graph  (C)  :  The  subgraph  of  network  N 
which  consists  of  the  subset  Be  of  all  (concealed)  branches 
incident  only  on  all  the  nonavailable  nodes. 


Theorem  A.l)  For  any  star  graph  whose  core  node  is  only  one 


f  a  i  &  j t  y*  U 1 
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nonavailable  node  and  at  least  two  of  the  outside  nodes  are 
A  ,  then  the  network  is  solvable. 

Proof.  Consider  Fig.  A.l  as  a  model  of  step  4. 


V  T 

i  L  l 


1 -  -  *  -  -  -  ; 
I  . — 


IS  I  »  I - | 

V  — *-o 

A  i-A-i 

I 


Fig.  A.l  A  Model  for  the  Step  4 


We  set  two  available  nodes  as  A^  and  We  also  set 

the  rest  of  the  nodes  connected  to  nonavailable  node  I  as  P^, 
P_,  . P  .  Node  voltages  and  currents  to  the  I  node  are 
represented  as  VM>  Vpr  Vp2 . Vpr  and  ^  ^ 

I  .  ,  I  ...,I  .  The  node  voltage  of  I  is  represented  as 

PI  P  c  FT 

V  .  The  unknown  admittance  of  each  branch  is  represented  as 
YA1'  YA2'  YF 1 ' YP2 '  *  * ’ ' YPr ’ 


Step  1)  Set  VA1  =  Vr  VA2  =  Vpl  =  ^ 


..  =  vpr  =  0. 


set  y  =  yp1  +  yp2  +  ...  +vpr. 


Measure  I, 


1^,  then 


Y,  ,  Y.  0  +  Y 
Al  A2 


JA1  ll 


(A.l) 


~r  ->4.  u  ’ 


v*,. 
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V1  '  RlIl  “  <h  +  V  Ex 


(A. 6) 


V1  '  R1I1  =  V2  "  cR2I2 


(A. 7) 


From  Eq.  (A. 6) , 


R  = 


V1  -  Vi 


‘  *k  +  *2 


(A. 8) 


vi  "  Vi  =  v2  -  * - Y~T  '2 

a2  R  RX 


(A. 9) 


From  Eq.  (A. 9) 


I  =  (v;  -Vj  +  Vl>  (  if  +  |  -  iT  > 

2  x 


(A. 10) 


Substitute  liq.  (A. 10)  for  Eq.  (A. 8),  then 


RX  " 


V1  -  Vi 

R  (R  +  RJ  _  RR 

L  +  (v2  -  V1  +  R1I1>  RR2Rx  - 1 


(A.U) 


Solving  Eq.  (A. 11),  we  get 


R  = 
x 


_ ^2 _ 

Il{  R2  +  (V2  "  V1  +  R1  1}  {R  +R2} 


Likewise,  we  can  determine  all  the  YR^,  .  ..,  Ypr' 


qed. 


Consider  a  given  network  N  partitioned  into  two 
subnets  and  N2  along  with  some  common  nodes  N^ .  We 
assume  all  the  branches  among  are  included  in  the  subnet 
N-p  We  denote  N2  1  as  N2  with  replacing  to  all  available 
nodes. 

Theorem  A. 2)  If  and  N2 '  are  solvable,  then  N  is  also 
solvable. 

Proof.  Since  is  solvable,  we  can  get  the  element 
values  of  subnet  .  Therefore  we  can  get  te  voltages  and 
currents  of  N3  always.  That  is  we  can  consider  N3  as 
available  nodes.  Now  we  can  divide  the  network  N  into  two 
subnets  along  with  the  available  nodes.  We  know  and  N2 ' 
are  solvable.  Therefore  the  network  N  is  solvable. 

qed. 


Example  A.l 


N 


N  1  N 
2  5 

1^37*  1 6 


4  ^7 


N3  =  {2,  3,  4} 


V 


t  2 

1  o — y  3 


:  solvable  3 


2'  o-  <  5 
N2  :  3  '  o-  -*  6 
4'  _ _ k  7 


:  solvable 


N  is  solvable. 


Consider  the  network  N  which  meets  the  following 


Aa,  K  ’ 


«  .  %  -  -  ■*.  * 
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*  conditions. 

1)  All  the  nodes  in  the  network  N  are  tied  to  one 
nonavailable  node. 

2)  The  network  N  has  at  least  three  separate  subnets  when 
we  eliminate  all  the  branches  to  the  nonavailable  node. 

3)  Each  newly  generated  subnet  is  solvable. 

4)  The  network  N  has  at  least  one  isolated  available  node 
when  we  eliminate  all  the  branches  to  the  nonavailable  node. 

Theorem  A .  3 )  The  above  network  N  is  element  value  solvable. 

Proof.  Suppose  the  network  N  is  divided  into  subnets 
Njy  and  N2,  and  .  N  consists  of  only  one  available  node, 
l  Number  of  nodes  for  N2  and  N3  are  n2  and  n^.  That  means  we 

have  n  *  l+n2+n3  available  or  partly  available  nodes.  When 
we  apply  star-mesh  transformation,  the  network  will  be  a 
complete  graph  Kn.  We  can  measure  all  the  branch  voltages 
and  currents.  And  also  the  transformed  portion  from  star 
network  of  the  mesh  network  should  satisfy  Shen's  (79) 
condition.  We  can  generate  all  the  element  values  only 
using  the  measurements  between  the  and  N’2 ,  and  N3,  and 
N2  and  N3 . 

Suppose  we  want  to  calculate  for  any  element  values 
between  n3i  and  n3^  in  N3>  We  measure  the  element  value  of 
the  branch  n^..  ,  n2kn7^  ,  and  n^^.  n2k  is  an  available 

.  node  of  N~ .  Therefore  we  can  get  all  the  values  in  K  .  The 

*  n 

difference  between  theoretical  measurement  and  actual 
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measurement  represented  as  an  admittance  value  is  the 
element  value  before  star-mesh  transformation.  Therefore  we 
can  solve  the  element  values  of  the  original  network  by 
mesh-star  transformation. 

qed. 

Example  A. 2 


Theorem  A. 4)  If  a  key  subgraph  is  tree  graph  and  the  core 
nodes  of  tree  graph  satisfy  following  conditions  then  the 
key  subgraph  is  also  solvable. 

1)  Each  core  node  which  incidents  only  one  other  core  node 
is  connected  with  at  least  1  A  and  1  A  or  P. 

2)  Core  nodes  which  incident  with  more  than  two  other  core 


9  frr- 


531 
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nodes  are  connected  with  at  least  1  A. 

Proof.  It  sufficies  to  show  that  the  condition  given 
in  this  theorem  agrees  with  the  condition  given  in  the 
Theorem  A. 3.  We  can  eliminate  the  core  node  by  star-mesh 
transformation  until  only  one  nonavailable  node  is  left. 
And  the  conditions  given  in  Theorem  A. 4  guarantees  the 
unique  solvability. 

qed. 

Theorem  A. 5)  If  for  any  nonavailable  node  I ,  at  least  two 
nodes  are  connected  to  free  A  and  all  others  are  connected 
to  A  or  P  and  only  one  other  nonavailable  node  is  connected, 
then  you  can  reduced  the  network  for 
network-solvable-purpose . 

Example  A. 3 


x> 


solvable 


Original  graph 


Reduced  graph 


If  the  reduced  network  is  solvable,  then  the  original 
network  is  also  solvable. 
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Col  A. 1)  A  network  N  is  solvable  if  following  conditions 
are  all  satisfied. 

1.  Its  key  subgraph  is  solvable. 

2.  The  network  remaining  after  all  branches  adjacent  to 
the  core  graph  C  of  key  subgraph  K  are  deleted  is  solvable. 

3.  The  subgraph,  which  is  comprised  of  key  subgraph  K 
enlarged  by  including  all  the  branches  both  ends  of  which 
are  on  the  key  subgraph  K  is  also  solvable. 

We  note  in  passing  that  our  Theorem  A. 3  appears  to  be 
related  to  the  theorem  given  recently  by  Mayeda  (82). 

A. 3. 2  Algorithm  for  Checking  Network  Solvability  of  the 
Key  Subgraph  K 

1.  Find  the  longest  length  of  core  graph  (tree). 

2.  Disrupt  connectivity  (  To  leave  the  most  favorable 
branch  set  ) . 

3.  The  reduced  graph  K  of  K  generated  by  following  rule 
is  solvable. 

a)  Every  node  of  branch  connectivity  one  in  the  core 
graph  can  be  changed  to  the  available  terminal  A  if  the  node 
has  at  least  two  branch  connectivity  with  available  nodes. 

b)  Every  node  of  branch  connectivity  one  in  the  core 
graph  can  be  changed  to  the  partly  available  nodes  if  the 
node  has  at  least  two  partly  available  nodes. 

4.  If  the  reduced  graph  K  of  K  is  solvable  graph  then  the 
key  subgraph  K  is  solvable,  otherwise  go  to  5. 
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5.  If  we  can  reduce  further  go  to  step  3  and  repeat, 
otherwise  stop  and  K  is  not  solvable. 

A. 3. 3  Two  Element  Kind  Network 

Theorem  A. 6)  For  a  two  element  kind  network  if  the 
following  reduced  subgraphs  are  solvable  then  the  network 
itself  is  solvable. 

1.  Exclude  all  the  Y  elements,  then  we  have  the  graph  Gxo 
composed  of  X  element  only.  Find  the  subgraph  of  Gxo  which 
is  solvable. 

2.  Short  circuit  all  the  Y  elements,  we  have  the  graph  Gxs 
composed  of  X  element  only.  New  subgraph  will  have  m  nodes 
less  than  the  original  graph.  Find  the  subgraph  of  Gxs 
which  is  solvable. 

3.  If  the  union  of  the  branches  of  the  solvable  subgraph 
in  the  step  1  and  2  is  X,  then  the  elements  of  X  are 
solvable. 

4.  Exclude  all  the  X  elements,  then  we  have  the  graph  Gyo 
composed  of  Y  elements  only.  Find  the  subgraph  of  Gyo  which 
is  solvable. 

5.  Short  circuit  all  the  X  elements,  we  have  the  graph  Gys 
composed  of  Y  elements  only.  New  subgraph  will  have  n  nodes 
less  than  the  original  graph.  Find  the  subgraph  of  Gys 
which  is  solvable. 

6.  If  the  union  of  the  branches  of  the  solvable  subgraph 
in  the  step  4  and  5  is  Y,  then  the  elements  of  Y  are 


4 
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’  solvable. 

7.  X  and  Y  elements  are  all  solvable,  then  the  network  is 
solvable . 

A.  4  Summary 

The  main  results  of  this  chapter  are  : 

1.  Introduction  of  the  core  graph  as  an  important  key  to 
the  solvability  of  the  networks. 

2.  A  refined  method  of  determining  the  element  value 
solvability  of  the  system, 

—  Necessary  and  sufficient  conditions  for  single  and 
two  element  kind  network  solvability. 

3.  Algorithm  of  reducing  the  system  for  solvability 
purpose . 

,  — —  a  systematic  procedure  has  been  developed  for 

determining  the  network  solvability  given  three 
kinds  of  terminals. 

4.  Illusrative  examples  including  previous  results  of 
Bedrosian  (78). 


4 

* 
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Appendix  B 

NAP 2  Nonlinear  Analysis  Program  (85,86) 

B.l.  Introduction 

For  convenience  we  summarize  the  main  features  of  the 
computer  program  utilized  to  simulate  the  electronic 
circuits  used  to  develop  and  illustrate  the  analog  fault 
isolation  techniques. 

NAP 2  is  a  Nonlinear  Analysis  Program  for  lumped 
electronic  circuit  simulations.  The  program  covers  DC, 
transient,  and  frequency  domain  analysis.  The  input 
language  is  format  free  and  allows  the  user  to  build  his  own 
models  that  can  be  stored  in  a  library  for  later  use.  The 
solution  is  based  upon  a  hybrid  formulation  of  network 
equations  and  sparce  matrix  technique.  For  nonlinear 
circuits  the  Newton-Raphson  method  is  followed  and  in 
transient  analysis  a  implicit,  variable-order,  variable-step 
integration  scheme  is  used.  Sensitivities  are  computed  from 
the  adjoint  network  in  the  DC  analysis,  while  the  time 
dependent  sensitivities  are  calculated  directly  from  the 
difference  equations  produced  by  the  integration  formula. 

NAP 2  has  the  following  features.  The  program  is  coded 
in  FORTRAN  IV  for  an  IBM  370/165  system.  The  storage 
requirements  of  the  present  version  are  104  K  bytes.  With 
this  region  size  the  program  limitations  are: 
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♦number  of  primary  current  variables  £  50 

Circuit  description  statements 
♦number  of  diodes 

+6  *  number  of  bipolar  transistors 

+6  *  number  of  field  effect  transistors 

♦number  of  output  options  <  195 

Subparameters 

+2  *  number  of  functional  values 

+4  *  number  of  nonlinear  couplings 

+4  *  number  of  bipolar  transistors 

♦8  *  number  of  field  effect  transistors 

♦2  *  number  of  diodes  <  276 

B.2.  Model  Library 

NAP 2  provides  an  arbitrary  collection  of  statements  to 
be  stored  in  a  library  for  later  use.  Six  libraries  are 
available  under  the  names:  LIB1,  LIB2,...,  LIB6.  Although 
the  program  offers  diodes,  transistors,  and  field  effect 
transistors  as  built-in  models,  we  might  enrich  the  program 
by  using  the  libraries. 

During  the  modeling  of  the  circuit,  we  have  generated 
and  used  several  transistor  and  diode  models. 
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B.3.  Model  of  a  Transistor  and  two  diodes 


*LIB3  NEW 
*LIB3  IN649  *- 

QEXP/EXP/  A  -0.251E-9  B  0.251E-9  D  3.831E-2  L  -0.5  U  2. 
QCJl/ABS/  B  0.108E-10  C  0.864  D  -0.577 
RB  3  2  0.532 
RS  1  3  0.123E12 
CJ  1  3  1*QCJ (VID) 

ID  1  3  1*QEXP1(VID) 


*LIB3  IN752  t- 

QEXP2/EXP/  A  -1.25E-11  B  1.25E-11  D  3.247E-2  E  1.  L  -.5  U  2. 

QCD2//  B  3.1E-6  C  1.25E-11 

QCJ2/ABS/  B  3.31E-10  C  .75  D  -.5 

RB  3  2  11 

RS  1  3  l.EC 

CD  1  3  1*QCD2 ( IID) 

CJ  1  3  1*QCJ2 (VID) 

ID  1  3  1*QEXP2 (VID) 


( 


A 


*LIB3  N2222A+ 

QJE4/EXP/  A  -3.02E-11  B  3.02E-11  D  40. 

QJC4/EXP/  A  -1.19E-10  B  1.19E-10  D  38. 

OCE4/ABS/  B  2.2E-11  C  0.9  D  0.4 

QCC4/ABS/  B  1.3E-11  C  0.9  D  0.35 


RB 

9 

1 

0.05 

RC 

7 

2 

2.8E-3 

CE 

9 

8 

1*QCE4 ( VCE) 

CC 

1 

2 

1*QCC4 (VCC) 

IE 

1 

8 

1*QJE4 (VCE) 

IC 

1 

2 

1*QJC4 (VCC) 

IN 

2 

1 

0 . 9927*QJE4 (VCE) 

II 

8 

1 

0 . 697*QJC4 (VCC) 

L  -0, 
L  -0, 


U  2. 
U  2. 
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